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SUMMARY 


Problem  and  Objective 

The  Advanced  Systems  Division  of  the  Air  Force  Human  Resources 
Laboratory  (AFHRL)  has  initiated  a  two- phase  effort  to  integrate  and 
apply  five  human  resource  technologies  to  the  weapon  system  acquisition 
process  as  the  coordinated  human  resource  technology  (CHRT).  The  five 
technologies  are  human  resources  in  design  trade-offs,  maintenance  man¬ 
power  modeling,  instructional  system  development  (training),  job  guide 
development  (technical  manuals),  and  system  ownership  costing.  Phase 
One,  the  integration  of  these  technologies  and  the  development  of  CHRT,  is 
complete  and  is  documented  in  AFHRL-TR-78-6,  Volumes  I,  II,  and  m. 
Phase  Two.  the  application  of  CHRT  in  a  weapon  system  acquisition  pro¬ 
gram.  is  being  performed  in  three  parts:  Part  1,  using  conceptual  phase 
data;  Part  2,  using  validation  phase  data;  and  Part  3  using  full-scale  devel¬ 
opment  phase  data.  Parts  1  and  2  are  complete  and  are  the  subject  of 
this  report  which  documents  the  activity,  results,  and  conclusions  drawn 
from  the  conceptual  and  validation  phase  demonstrations.  The  results 
of  Part  3  will  be  documented  in  a  separate  technical  report. 


Approach 

The  Advanced  Medium  STOL*  Transport  (AMST)  was  the  acquisi¬ 
tion  program  selected  for  CHRT  application.  The  actual  conceptual  and 
validation  (prototype)  phases  of  the  AMST  acquisition  were  complete  and 
data  appropriate  to  each  phase  were  available  when  this  demonstration 
began.  For  each  phase  of  the  demonstration,  the  data  were  compiled, 
the  baseline  and  alternative  system  and  support  design  approaches  were 
Identified,  and  the  CHRT  process  was  applied.  The  term  system  design, 
as  used  in  this  report,  refers  to  the  hardware  and  software  design  while 
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the  term  support  refers  to  the  logistic  support  element  design.  During 
the  course  of  the  demonstration,  the  CURT  techniques  and  data  pro¬ 
ducts  were  evaluated.  The  techniques  were  improved,  added  to,  or 
deleted  where  necessary.  Data  product  presentation  was  also  improved. 
In  all  cases,  CHRT  was  applied  as  it  might  be  by  a  system  program  or 
acquisition  logistics  manager. 


Results  and  Conclusions 

The  results  of  each  phase  of  the  demonstration  are  analyzed  and 
conclusions  drawn  regarding  the  methodology  used  to  derive  the  results. 

In  cases  where  modification  to  the  methodology  was  determined  appro¬ 
priate,  the  effectiveness  of  the  modification  is  also  evaluated. 

Three  major  objectives  of  this  demonstration  have  been  achieved: 

A.  Manpower  requirements,  training  requirements,  technical  manuals 
requirements,  reliability,  maintainability,  and  system  ownership 
costs  have  been  quantified  for  several  system  and  support  design 
alternatives  and  at  various  levels  of  equipment  detail. 

1.  During  the  conceptual  phase  demonstration,  requirements 
and  costs  were  quantified  for  the  following  designs: 

•  A  two- man  flight  deck  avionics  suite 

•  A  three- man  flight  deck  avionics  suite 

•  A  new  landing  gear 

•  A  modified  landing  gear 

2.  During  the  validation  phase  demonstration,  requirements 
and  costs  were  updated  and  quantified  at  the  subsystem  level 
for  the  following  designs: 

•  A  two- man  flight  deck  avionics  suite 

•  A  three- man  flight  deck  avionics  suite 

•  A  modified  landing  gear 

•  An  integrated  digital  avionics  suite 


Assessments  were  also  made  at  the  subsystem  level 
(a  sub- set  of  a  major  system)  for: 

•  Standard  Station  Keeping  Equipment 

e  Insertable  Station  Keeping  Equipment 

B.  A  new  technique  to  implement  an  integrated  approach  to  training 
and  technical  manuals  early  in  acquisition  has  been  developed. 

Two  basic  approaches  have  been  considered.  One,  the  conventional 
approach,  assumes  primarily  five- level  personnel  on  the  flight 
line,  supported  by  conventional  training  and  standard  technical 
manuals.  The  other,  the  task-oriented  approach,  assumes 
primarily  three- level  personnel  on  the  flight  line,  supported  by 
task-oriented  training  and  proceduralized  technical  manuals. 

1.  These  are,  in  fact,  logistic  alternatives  and  may  be  reflected 
in  requirements  and  cost  estimates.  All  designs  considered 
during  the  validation  phase  were  assessed  for  the  conven¬ 
tional  approach.  Additionally,  the  two-man  flight  deck 
avionics  and  landing  gear  were  also  assessed  for  the  task- 
oriented  approach.  The  technique  used  to  reflect  these 
different  approaches  was  successful  and  could  be  used  to 
consider  other  logistic  alternatives  in  such  areas  as 
support  equipment  or  spares. 

2.  The  results  quantifying  the  impact  of  the  conventional  and 
task-oriented  approach  for  both  the  two- man  flight  deck 
avionics  and  the  landing  gear  have  proved  a  very  useful 
input  to  the  "Integrated  Personnel,  Training,  and  Technical 
Manual  Section'"  of  an  Integrated  l  ogistic  Support  Plan.  A 
sample  is  included  in  the  Appendix  A  to  this  report  (Volume 
II). 

3.  A  technique  also  has  been  developed  to  estimate  the  relative 
need  for  and  extent  of  information  coverage  in  both  train¬ 
ing  and  technical  manuals.  This  estimate  is  developed  for 
the  specific  personnel,  training,  and  technical  manual 
approach  under  consideration  and  is  presented  in  a  training/ 
aiding  matrix.  This  matrix  is  developed  in  the  earlier 
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phases  of  acquisition  before  an  "on- equipment "  task  analysis 
has  been  accomplished.  Its  purpose  is  to  support  early 
training/tech  manual  program  definition  and  prioritization 
of  requirements. 

C.  A  single,  evolving  consolidated  data  base  to  service  the  require¬ 
ments  of  all  five  technologies,  as  implemented,  extended,  and 
enhanced  by  CURT,  was  established  in  the  conceptual  phase 
for  the  AMST  avionics  and  landing  gear.  It  was  maintained  and 
extended  during  the  validation  (prototype)  and  will  be  used  to 
initiate  the  full-scale  development  (minimum  engineering  develop¬ 
ment  phase). 
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HUMAN  RESOURCES.  LOGISTICS.  AND  COST  FACTORS 
IN  WEAPON  SYSTEM  DEVELOPMENT: 
DEMONSTRATION  IN  CONCEPTUAL  AND 
VALIDATION  PHASES  OF  AIRCRAFT 
SYSTEM  ACQUISITION 


I.  INTRODUCTION 


1.  1  BACKGROUND  AND  PURPOSE 

The  Advanced  Systems  Division  of  the  Air  Force  Human  Re¬ 
sources  Laboratory  (AFHUL)  has  initiated  a  two- phase  effort  to  inte¬ 
grate  and  apply  five  human  resource  technologies  to  the  weapon  system 
acquisition  process  as  the  coordinated  human  resource  technology  (CHRT). 
Phase  I,  the  integration  of  these  technologies  and  the  development  of 
CHRT.  is  complete  and  is  documented  in  AFHRL- TR- 78-6.  Volumes  I, 

II  and  III.  Phase  II.  the  application  of  CHRT  in  a  weapon  system  ac¬ 
quisition  program  is  being  performed  in  three  parts:  Part  1,  using 
conceptual  phase  data;  Part  2,  using  validation  phase  data;  and  Part  3, 
using  full  scale  development  phase  data.  Parts  1  and  2  are  complete. 

Part  3  is  in  progress. 

This  report  describes  the  results  to  date  of  Parts  1  and  2  of  the 
CHRT  demonstration  on  the  Advanced  Medium  STOl/  Transport  (AMST) 
acquisition  program.  The  purpose  of  the  demonstration  is  to  validate  the 
CHRT  concept  and  its  application  in  each  phase  of  acquisition.  The  re¬ 
sults  of  this  demonstration  will  be  utilized  to  refine  and  update  the  CHRT 
concept  and  consolidated  data  base  (CDB)  specification  and  to  develop 
implementing  documentation  for  CHRT  and  CDB  in-service  application. 

1.2  COORDINATED  HUMAN  RESOURCE  TECHNOLOGY  CONCEPT 

CHRT  provides  a  method  to  predict  and  quantify  the  human  re¬ 
sources  (HR)  and  system  ownership  costs  (SOC)  associated  with  a  weapon 
system.  CHRT  also  provides  a  technique  to  implement  an  integrated  con¬ 
sideration  of  the  personnel,  training,  and  technical  manuals  required  to 
support  the  weapon  system.  Knowledge  of  HR  and  SOC  requirements 
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facilitate  identification  and  selection  of  these  system  and  support  design 
approaches  which  reduce  and/or  more  effectively  utilize  human  resources 
and  which  reduce  SOC.  The  implementation  of  an  integrated  consideration 
of  the  personnel,  training  and  technical  manuals  required  to  support  the 
weapon  system  helps  to  achieve  these  efficiencies.  The  expression  sys¬ 
tem  and  support  design  is  used  often  in  this  total  study.  In  clarification, 
the  term  system  refers  to  the  weapon  system  hardware  and  software. 

The  term  support  refers  to  the  weapon  system  Integrated  logistic  support 
elements. 

The  Coordinated  Human  Resource  Technology  represents  an  inte¬ 
gration  of  the  five  human  resource  technologies: 

•  Maintenance  Manpower  Modeling  (MMM)  -  a  method  for 
estimating  the  maintenance  manpower  requirements  for 
aircraft  systems.  This  technology  uses  the  Ix>gl8tic 
Composite  Model  (LOOM)  to  simulate  the  maintenance 
system. 

•  Instructional  System  Development  (ISD)  -  a  methodology 
described  in  AFM  50-2  for  qualifying  personnel  to  perform 
tasks  through  an  optimized  training  program. 

3 

•  Job  Guide  Development  (JGD)  -  a  method  of  developing 
a  broad  range  of  troubleshooting  (TS)  and  non-trouble¬ 
shooting  (NTS)  technical  manuals  designed  to  reduce 
training  time  and/or  skill  required  to  perform  a  task. 

These  technical  manuals  are  an  alternate  and/or  supple¬ 
ment  to  ISD  as  a  means  for  qualifying  personnel. 

•  System  Ownership  Cost  (SOC)  -  a  systematic  method  of 
estimating  operating  and  support  costs  and  identifying  major 
cost  contributors. 

•  Human  Resources  in  Design  Trade-Offs  (HRDT)  -  an  approach 
utilizing  the  design  option  decision  tree  (DODT)  for  identifying 
system  and  support  design  trade-offs,  so  that  the  human  re¬ 
source  impact  of  the  critical  alternatives  at  those  decision 
points  may  be  determined. 


3 

The  term  job  guide  and  technical  manual  are  used  to  express  the  same 
concept.  Technical  manual  is  the  preferred  term,  however,  and  will 
be  used  in  describing  new  work. 


12 


The  development  of  CHRT  from  the  individual  technologies  and 
the  structure  of  the  CDB  from  which  CHRT  operates  are  fully  described 
in  AFHRL-TR-78-6  (I,  II  and  III).  That  report  documents  a  7  month 
development  effort  and  is  synopsized  as  follows: 

Traditionally,  the  five  technologies  have  been  applied  independently, 
at  various  discrete  times  and  generally  late  during  the  weapon  system 
acquistion  process.  Their  application  and  contribution  may  be  summarized 
as  follows: 

•  MMM  has  been  applied  to  various  aircraft  systems  during 
the  validation  and  full-scale  development  phases  in  order  to 
predict  system  maintenance  manpower  requirements  using 
the  LOOM  simulation. 

•  ISD  as  a  decision-making  process  is  applied  late  in  the 
validation  phase  to  define  the  ISD  program  and  also  theoreti¬ 
cally  to  define  the  applicability  of  job  guide  documentation. 
This  latter  determination,  when  accomplished,  is  the  sole 
coordinated  1SD/JGD  activity.  ISD  as  a  product- oriented 
process  then  continues  through  full-scale  development  into 
production /deployment. 

•  JGD  is  initiated  in  full-scale  development  as  a  product- 
oriented  effort.  During  the  course  of  its  associated  task 
analysis,  a  reconsideration  of  the  training /support  equip¬ 
ment/job  guide  mix  may  be  made. 

•  SOC  is  not  presently  a  rigorous  technology  but  rather  a 
Defense  Systems  Acquisition  Review  Council  (DSARC) 
milestone  requirement.  It  is  normally  responded  to  with  a 
point  cost  estimate.  Equations  and  models  for  obtaining 
these  estimates  are  not  standardized  nor  do  the  sources  of 
data  always  adequately  reflect  the  system  being  costed. 

e  HRDT  exists  as  the  DODT  technique  and  as  a  concept  of 
using  HR  data  in  design  trade-offs.  It  can  be  applied  at 
many  levels  of  detail  throughout  system  acquisition. 

There  is,  however,  no  standardized  technique  for 
interfacing  with  the  other  technologies  to  obtain  the 
HR  or  SOC  data  associated  with  the  design  alternatives. 


13 


Pi  gure  1  depicts  the  above  summary  of  the  traditional  application 
of  the  five  human  resource  technologies  during  weapon  system  acquisition. 


There  are  recognized  similarities  in  activities  and  data  require¬ 
ments  among  the  five  technologies.  AFHRL-TR-78-6  (I.  n,  and  HI) 
explores  these  similarities  and  describes  the  potential  for  expanded  and 
integrated  application  of  the  technologies.  This  potential  application  is 
depicted  in  Figure  2: 


e  MMM  is  initiated  in  the  conceptual  phase.  A  generalized 

maintenance  task  analysis  is  performed  based  on  comparative 
system  historical  data  and  maintenance  action  networks  are 
developed.  The  average  value  method  devised  for  the  Digital 
Avionics  Information  System  (DAIS)  Life  Cycle  Cost  (LCC) 
Study,  the  Reliability  and  Maintainability  (R&M)  model,  is 
used  to  investigate  maintenance  manpower  requirements, 
as  well  as,  reliability  and  maintainability  data.  Reliability 
and  maintainability  directly  affect  human  resource, 
logistics,  and  cost  requirements.  These  results  are 
directly  reflected  in  the  SOC  estimate  and  are  usable  for 
DSARC  I.  The  maintenance  task  analysis  information  and 
the  maintenance  manpower  requirements  are  both  used  as 
input  data  to  the  ISD/JGD  decision  process. 
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•  MMM  is  updated  in  the  validation  phase  through  a  review 

of  the  generalized  maintenance  task  analysis  data  and  main¬ 
tenance  action  networks.  Maintenance  manpower  require¬ 
ments  are  again  investigated  using  the  RAM  model.  The 
LCOM  simulation  ip  used  only  to  refine  maintenance  man¬ 
power  requirements  for  systems  or  subsystems  of  signi¬ 
ficant  interest.  Reliability  and  maintainability  data  are 
updated.  The  results  are  reflected  in  the  SOC  estimate 
usable  for  DSARC  II.  The  general  maintenance  task  data 
and  the  maintenance  manpower  requirements  determined 
at  this  time  continue  to  be  used  as  input  to  the  ISD/JGD 
decision  process. 


•  MMM  is  updated  in  the  full-scale  development  phase  by  re 
placing  the  general  maintenance  task  data  with  that  de¬ 
rived  from  the  initial  steps  of  an  ISD/JGD  Integrated  task 
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DSARC  I  DSARC  II  OSARC  III 


PRESENT  HUMAN  RESOURCES  TECHNOLOGY  APPLICATION 


MARC  I  OSARC  II  MARC  III 


RESOURCES  TECHNOLOGY  APPLICATION 


analysis.  LCOM  is  used  to  confirm  earlier  predictions 
of  maintenance  manpower  requirements.  Reliability  and 
maintainability  data  derived  throug  the  R&M  model  are 
required  for  use  with  the  SOC  model.  Maintenance  man¬ 
power  requirements  are  fedback  to  1SD/JC.D  integrated 
task  analysis. 

e  The  ISO/JGD  decision  process  is  initiated  in  the  conceptual 
phase  and  continued  during  the  validation  phase  to  continually 
refine  the  ISD/JGD  requirement.  The  training  and  technical 
manual  requirement  again  is  reflected  in  the  SOC  estimates 
for  both  DSARC  I  and  II  and  in  the  training  and  technical 
manual  plans. 

e  A  single  integrated  task  analysis  on  the  actual  system  is 
initiated  during  full-scale  development.  This  analysis  is 
used  to  define  the  training /technical  manual  trade-off  and 
subsequently  for  training  and  technical  manual  development. 

e  Operational  manpower  requirements  and  the  necessary  ISD 
to  support  this  manpower  requirement  in  each  phase  is 
determined.  These  data  are  needed  to  supplement  the  data 
provided  by  the  five  technologies. 

•  A  single  I.CC  model  which  can  be  applied  with  continuity 
through  all  acquisition  phases  is  used.  This  model  is  inter¬ 
active  with  the  R&M  model  and  is  especially  sensitive  to 
SOC. 

•  HRDT  is  incorporated  in  all  phases.  This  technology  pro¬ 
vides  a  feedback  loop  to  the  others  and  allows: 

•  Assessment  of  existing  designs  to  identify  areas 

requiring  excessive  human  resources  or  binding.  In 
addition  to  drawing  attention  to  these  ’’high  drivers  ', 
the  assessment  will  identify  potential  solutions  to  the 
identified  problem  area. 
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•  Evaluation  of  alternative  system  and  support  design 
approaches  in  terms  of  the  human  resources  con¬ 
siderations  and  operating  and  support  costs.  The 
human  resource  requirements  and  associated  cost 
implications  would  then  be  used  as  part  of  the  de¬ 
cision-making  process  in  selecting  an  appropriate 
alternative. 

•  Ail  significant  data  required  to  support  the  five  individual 
technologies  are  consolidated  in  a  single  data  base,  the 
CDB.  The  content  of  the  CDB,  as  conceptually  described 
by  AFHRL-TR-78-6  (III),  is  depicted  in  Figure  3. 

The  concept  of  the  maintenance  action  network  as  a  means  of 
modeling  the  maintenance  system  is  critical  to  the  application  of  the  CHRT. 
To  ensure  a  basic  understanding,  a  very  brief  description  of  the  mainten¬ 
ance  action  network  as  used  with  the  RAM  model  is  provided  in  the  next 
paragraph.  A  more  complete  description  is  included  in  AFHRL-TR- 78-2. 

The  generalized  maintenance  action  network  depicted  in  Figure  4 
represents  the  types  of  flight  line  and  shop  maintenance  anticipated  in 
an  aircraft  system.  Each  branch  of  this  network,  with  the  exception  of 
subsystem  failure,  is  annotated  with  probability  of  occurrence,  time 
to  complete  action,  maintenance  personnel  characteristics  (skills,  levels, 
and  numbers)  and  support  equipment  requirements,  subsystem  failure  is 
only  annotated  with  probability  of  occurrence.  The  RAM  model  operates 
on  these  networks  and  provides  average  values  for  maintenance  manpower 
requirements  and  mean  time  to  repair  at  the  subsystem  level  for  the 
flight  line  and  at  the  line  replaceable  unit  (LRU)  level  for  shop.  The  data 
used  to  annotate  these  networks  in  the  early  acquisition  phases  are 
developed  from  an  analysis  of  historical  data  on  comparable  equipment. 
This  analysis  must  judgmentally  consider  the  source  of  the  historical 
data  and  the  intended  application  of  the  proposed  system.  These  data  are 
gradually  replaced  with  actual  subsystem  data  as  the  subsystem  hardware 
is  built  and  used  data  are  collected.  The  networks,  therefore,  grow  from 
an  estimated  to  an  actual  model  of  the  maintenance  system. 
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1.3 


CURT  AND  THK  WEAPON  SYSTKM  LI  IK  CYCLE 


CURT  is  applied  iteratively  across  all  phases  of  the  weapon 
system  life  cycle.  On  any  one  weapon  system,  it  provides  continuity 
of  both  source  and  rationale  for  HR  and  SOC  data.  The  source  is  a 
CDB  which  is  initiated  in  the  conceptual  phase  and  updated  in  accuracy 
and  detail  as  acquisition  proceeds.  Comparable  systems  information 
is  used  to  establish  and  maintain  the  CDB  until  actual  system  informa¬ 
tion  is  available  usually  during  full-scale  development. 

The  HR  and  SOC  information  is  derived  from  the  CDB  and, 
therefore,  is  directly  dependent  for  accuracy  and  level  of  detail  on  the 
CDB.  The  rationale  or  metnodology  for  developing  the  HR  and  90C 
data  remains  basically  unchanged  throughout  acquisition.  The  HR  data 
which  CHRT  predicts  and  quantifies  are  operations  and  maintenance 
manpower  requirements  (quantity,  skills,  and  skill  levels),  training 
course  length  (time),  and  technical  manual  content  (number  and  type 
of  pages).  Additionally,  CHRT  predicts  and  quantifies  reliability 
(MFHBMA)4  and  maintainability  (MTTR)5.  These  latter  data  are 
useful  directly  and  are  also  required  for  SOC  computation.  90C  is 
that  portion  of  LCC  consisting  of  the  non-recurring  support  invest¬ 
ment  and  the  recurring  operating  and  support  costs.  The  availability 
of  this  human  resource  related  data  in  turn  facilitates  the  assessment 
of  baseline(s)  and  alternat ive(s)  and  the  identification  of  "high 
drivers."  Throughout,  training  and  technical  manuals  are  addressed 
as  a  coordinated  pair  and  are  considered  as  either  conventional  or 
task-oriented  in  nature.  The  conventional  approach  emphasizes  broad 
based  training  in  theory  and  system  operation  which  is  supported  in 
the  field  by  deductive  technical  manuals.  The  task-oriented  approach 
emphasizes  "hands  on"  training  in  key  tasks  which  is  supported  in  the 
field  by  directive  technical  manuals.  Additional  predictive  information 
is  available  through  the  DODTs  which  depict  potential  design  decision 
points  and  available  alternatives. 

CHRT  makes  use  of  three  logistic  resource  assessment 
models  developed  by  AFHRL:  the  RAM  model,  LOOM,  and  the 
Expected  Value  (KXPVAL)  model.  The  latter  is  an  average  value 
model  developed  for  use  with  LOOM.  An  LCC  model  directly  driven 
by  the  maintenance  system  represented  by  and  the  results  of  the  R&M 
model  provides  SOC. 


4M  FHBMA  -  mean  flight  hours  between  maintenance  actions 
SmTTR  -  mean  time  to  repair 


21 


Conceptual  Phase 


A  CDB  is  established  in  t lie  conceptual  phase  for  each  system 
configuration  under  consideration.  Kach  system  configuration  is 
termed  a  baseline  and  includes  a  tentative  maintenance/personnel/ 
training/ job  guide  approach.  HR  and  SOC  data  are  developed  for  each 
baseline  and  are  used  to  help  determine  which  baselinefs)  will  be 
continued  for  consideration  in  the  validation  phase.  The  accuracy  and 
level  of  detail  of  the  HR  and  SOC  information  are  adequate  to  support 
system  level  decisions  and  may  be  used  to  identify  risk  areas.  An 
integrated  personnel /training/technical  manual  concept  is  developed. 

Validation  Phase 

The  COB  is  updated  for  each  baseline  retained  for  validation 
phase  consideration.  More  detailed  comparability  information  may  be 
used  because  the  baseline  may  now  be  described  in  more  detail. 

Alter;  atives  within  each  baseline  are  also  identified  and  the  CDB  is 
extended  to  include  those  alternatives  that  require  consideration.  HR 
and  90 C  data  are  prepared  for  each  baseline  and  reiterated  within  a 
baseline  for  each  alternative.  The  accuracy  and  level  of  detail  of  the 
HR  and  SOC  information  at  this  stage  is  sufficient  to  support  both 
system  and  subsystem  decisions  and  may  be  used  to  quantify  risk 
areas  at  the  same  level.  An  integrated/personnel /t  raining/technical 
manual  plan  is  developed. 

Full-Scale  Development  Phase 

Normally  one  baseline  is  carried  into  full-scale  development. 
However,  many  alternatives  may  be  identified  within  this  baseline. 

The  CDB  is  updated  during  this  phase  with  actual  system  data  for  the 
baseline,  and  with  comparable  or  actual  system  data  for  those  alter¬ 
natives  under  consideration.  HR  and  SOC  data  are  then  prep  '  and 
may  now  be  used  to  support  system,  subsystem,  and  detailec  cl 
decisions  and  to  verify  reduction  of  risk  areas.  During  this  ,  .ase  a 
task  identification  matrix  is  developed  which  identifies  the  maintenance 
tasks  required  to  be  performed  on  specific  equipments.  It  also  iden¬ 
tifies  the  level  of  maintenance  at  which  these  tasks  are  to  be  performed. 
As  such  the  task  identification  matrix  reflects  the  maintenance  concept. 
The  task  identification  matrix  is  then  annotated  to  indicate  where 


instruction  to  accomplish  those-  tasks  will  bo  provided,  framing, 
technical  manuals,  or  both  aro  the  options  available.  Hubs  for 
annotating  the  task  identification  matrix  are  developed  from  the  per¬ 
sonnel/training/technical  manual  plan  and  directly  reflect  the  per¬ 
sonnel  skills  and  levels  desired  and  qualification  approach  required. 
This  annotated  task  identification  matrix  then  forms  the  basis  for  the 
training  and  technical  manual  procurement. 

Production /Development  and  Operations  Phase 

In  the  product  ion /deployment  and  operations  plia.se  the  CPU  is 
updated  with  new  and  more  current  actual  system  data  for  the  produc¬ 
tion  baseline.  Alternatives  may  now  be  identified  m  terms  of  proposed 
engineering  changes  and  even  new  applications  to  meet  contingency 
requirements.  The  ('I)B  is  extended  to  include  any  alternative  to  be 
considered  and  till  and  SOC  information  are  generated  as  required. 
These  data  may  now  tie  used  to  support  the  user,  m-service  engineer¬ 
ing,  and  logisties.  The  data  also  mav  be  used  to  vrrilv  that  previously 
identified  risk  areas  have  been  eliminated,  and/or  to  identify  new  risk 
areas.  A  coordinated  training  and  technical  manual  program  is 
implemented  to  support  tin*  operation  and  maintenance  of  the  product¬ 
ion  system. 

1.4  ('ll HI  PHO( MSS 

The  elements  of  the  '  wr  an  resout  .  o  tei  hnologies  and  their 
proposed  coordinated  application  in  the  .  <>m  eptual  and  validation 
phases  are  depicted  in  figure  i  as  the  <  1IHI  process.  Al  Mill  -111- 
78-6(11)  contains  a  detailed  |.  s.  npt  um  o’  M  is  process  and  a  c  ompan¬ 
ion  figure-  depicting  t ) i*-  ('HIM  process  m  tin-  lull-scale  development 
phase.  I  he  following  .  omt-  <-nts  are  provided  as  a  suit. mars  of  tin- 
concept  depicted  hv  figure  a; 

•  The  process  is  shown  as  a  tumtion  flow  diagram.  It  is 
structured  in  a  systematic  iranm-r  winch  lends  itself  to 
computeri /at  ion. 

•  The  <‘I>B  consists  oi  all  •  quipment,  task,  n-.a inten atn-e, 
operations,  personnel,  and  cost  data  elements  stored  in 
matrices  and  listings.  The  C'DH  contains  all  information 
nrci-ss ar\  to  applv  C1IHT. 


•  Input  data  covers  design,  maintenance,  operations,  support 
and  cost.  The  source  and  validity  of  this  data  «U1  vary 
from  phase  to  phase. 

•  Output  data  includes  reliability,  maintainability,  mainte¬ 
nance  manpower  requirements,  training  and  technical 
manual  scope  and  content,  training  scope  for  operations, 
and  a  system  ownership  cost  estimate. 

•  The  CHRT  process  has  been  subdivided  into  four  main  activi¬ 
ties  which  are  indicated  by  dotted  lines: 

•  CDB  Development 

•  Integrated  Requirements  and  Task  Analysis 

•  ISD/JGD  Product  Development 

•  Impact  Analysis 

•  The  scope  of  the  integrated  requirements  and  task  analysis 
expands  with  time  during  the  weapon  system  acquisition 
process.  It  processes  all  the  task  data  necessary  for  pre¬ 
diction  and  definition  of  the  human  resource  requirements, 
as  well  as  that  required  to  prepare  the  ISD/JGD  products. 

•  The  impact  analysis  results  tn  comparative  human  resources 
and  cost  data  for  baseline(s)  and  alternative(s).  It  can  be 
accomplished  at  any  equipment  level  (i.e.,  system,  sub¬ 
system,  or  I. RID.  The  SOC  model  provides  the  means 

of  translating  human  resource  data  to  cost  data  on  both  a 
system  and  a  subsystem  basis. 

•  The  product  development  activity  utilizes  an  integrated 
approach  to  training  and  job  guide  development.  It  pro¬ 
vides  the  concepts,  plans,  and  programs. 

Although  the  CURT  process  appears  very  complex  when  described 
in  terms  of  the  individual  technologies  of  which  it  Is  composed,  it  is,  in 
reality,  a  very  straightforward  procedure  when  viewed  as  a  series  of 
interrelated  steps.  This  proceduralized  approach  is  described  in  the 
following  paragraphs,  and  is  based  upon  the  experiences  gained  from 
applying  CHRT  and  its  CDB  to  the  conceptual  and  validation  (prototype) 
phase  data  of  the  AMST. 


-'5 


The  steps  are  described  along  with  a  marginal  nutation  of  the 
basic  source  technology.  For  example,  HRDT  indicates  that  the  step 
was  developed  from  activates  within  the  HRDT  technology.  The 
notation  NEW  indicates  a  step  unique  to  t tie  CURT  process.  The  input 
data  and  output  data  of  the  step,  both  of  which  are  described,  make  up 
the  CDB.  Steps  are  applicable  to  ail  phases  unless  otherwise  indicated. 
Steps  accomplished  in  one  phase  may  simply  require  review  and 
update  in  subsequent  phases.  The  steps  follow. 

A.  Prepare  and  review  DOPTs  for  critical  trade-off  HRDT 

issues  involving  system  and  subsystem  equipment 

and  logistics  planning. 

B.  Determine  baseline  design,  operation,  maintenance,  HRDT 

and  support  approach(es)  and  alternatives  from  data 
collected  in  A. 

For  each  baseline  and  alternative: 

C.  Conduct  a  system  comparability  analysis.  Prepare  an  MMM 

equipment  listing  to  the  LRU  level  and  identify  com¬ 
parable  equipment  if  appropriate.  Estimate  or  deter¬ 
mine  MFHBMA  for  subsystem  or  major  equipment  and 

the  number  of  shop  replaceable  units  (SRU)  per  each 
LRU. 

D.  Prepare  a  maintenance  action  network  and  annotate  MMM 

each  action  with: 

(1)  Air  Force  specialty  code  (AFSC),  quantity,  and 
skill  level  of  maintenance  personnel. 

(2)  Time  and  probability  of  occurrence. 

(3)  Support  equipment  required,  setup,  and  use  time. 

(Note:  annotations  should  reflect  appropriate  personnel/ 
training/technical  manual  approach. ) 


Input  data  to  the  appropriate  logistics  resource  assess-  MMM 
ment  model. 


(1)  Use  the  R&M  model  in  all  phases  to  obtain  com¬ 
plete  HR  A  SOC  assessment. 

(2)  Use  LOOM  to  evaluate  maintenance  manpower  and 
support  equipment  requirements  for  baseline  and 
prime  alternatives.  (LCOM  considers  the  dynamics 
of  the  specific  scenario  being  evaluated).  Because 
of  the  resources  required  for  this  simulation,  it 
would  rarely  be  appropriate  prior  to  the  late  vali¬ 
dating  phase. 

(3)  Use  EXPVAL  when  only  average  values  for  mainten¬ 
ance  manpower  and  support  equipment  requirements 
are  desired.  It  may  be  applied  in  all  phases  as 
appropriate.  It  is  also  used  as  a  debugging  tool  for 
LCOM. 


Review  DAIS  R&M  model  output.  Extract  and/or  determine 
as  required. 


0) 


Per  subsystem /major  component/ LRU /SRU: 


Availability 


M FHBMA 
MFHBMA  ♦  MTTR 


M FHBMA 

Flight  line  -  troubleshooting  time,  maintain  on 
aircraft  time,  remove  and  replace  time,  MTTR, 
and  maintenance  manhours  per  flying  hour 
(MMff/FH). 

Shop  -  MTTR 


(2)  Maintenance  Manpower  requirements  per  AFSC  and 
skill  level  in  terms  of: 


•  MKH/FIt 

•  Manpower/ squadron 


(3)  Support  equipment  requirements  per  unit 
in  terms  of: 

•  Support  equipment  hours  per  flying  hour  (SEH/FH) 

•  Quantity  /squadron 

G.  Review  LCOM  output.  Extract  and/or  determine:  MMM 

(1)  Per  Subsystem  -  Maintenance  manpower  require¬ 
ments  (hours)  per  AFSC  and  skill  level. 

•  On- Equipment  Maintenance 

•  Off- Equipment  Maintenance 

(2)  Per  Subsystem  -  Support  equipment  use  (hours). 

•  On-  F'quipment  Maintenance 

•  Off- Equipment  Maintenance 

H.  Review  EXPVAL  output.  Extract  and/or  determine:  MMM 

(1)  Per  Subsystem  -  Maintenance  manpower  require¬ 
ments  in  (hours)  per  AFSC  and  skill  level. 

•  On- Equipment  Maintenance 

•  Off- Equipment  Maintenance 

(2)  Per  Subsystem  -  Support  equipment  use  (hours). 

•  On- Equipment  Maintenance 

•  Off- Equipment  Maintenance 

I.  Determine  operations  manpower  requirement  by  review  NEW 
of  system  documentation  and  calculate: 

•  Crew  composition,  rank,  and  years  of  service 

•  Manpower/ squadron  skill 
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Prepare  training  estimates  (time) 
(1)  Per  maintenance  AFSC 


NEW 


•  Identify  training  courses  required 

•  Determine  course  length  for  conventional 
and/or  task-oriented  approach 

(2)  Per  crew  AFSC 

•  Identify  crew  training  course 

•  Determine  course  length 

Prepare  technical  manual  estimates  (number  and  NEW 

type  pages). 

(1)  For  Shop  by  Equipment 

•  Conventional  only 

•  Troubleshooting/non- troubleshooting 

(2)  For  Flightline  by  Equipment 

•  Conventional  and/or  task  oriented 

•  Troubleshooting  'non-troubleshooting 

(Note:  The  task  identification  matrix  may  be  used  in  the 
full-scale  development  and  production  phases  as  the 
basis  for  the  final  training  and  technical  manual  estimates). 

Prepare  training /technical  manual  trade-off  definition 
matrices. 

(1)  Training /aiding  matrix  NEW 

(2)  Task  identification  matrices  -  full-scale  JGD 

development  and  production  phases. 
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Prepare  the  cost  model  for  SOC 
calculation. 

0 

(1)  Select  and/or  update  cost  area  equations. 

(2)  Update  standard  input  values. 

•  Pay  rates 

•  Personnel  turnover 

•  Spares  Pipeline  time 

(3)  Determine  unique  input  values. 

•  Crews/aircraft 

•  Number  of  aircraft 

•  Aircraft /squadron 

•  System  force  structure 

•  Flying  hours/ aircraft /day 

•  Cost /spare 

•  Support  Equipment  requirements 

•  Manpower  profile 

(4)  Obtain  acquisition  and  RAD  cost  data. 

(5)  Normalize  all  cost  data  to  appropriate  year. 
Operate  the  LCC  model  and  determine  SOC. 

(1)  Support  investment  cost  (one  time) 

(2)  OAS  costs  (annual) 

Review  and  correlate  HR  and  SOC  data  as  appro¬ 
priate  to: 

(1)  Present  individual  results 

(2)  Evaluate  impact  among  baseline(s)  and/or 
alternatives 

(3)  Identify  risk  and/or  payoff  areas 


NEW 


SOC 


NEW 
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P.  Reiterate  process  as  required  to:  NEW 

<1)  Update  HR  and  SOC  estimates 

(2)  Consider  additional  alternatives 

Q.  Prepare  ISD/JGD  product  appropriate  to  each  ISD/JDG 

phase  for  selected  baseline(s). 

(1)  Personnel/training/technical  manual  concept  - 
conceptual  phase 

(2)  Personnel /training/ technical  manual  plan  - 
validation  phase 

(3)  ISD/JGD  program  definition  -  full-scale 
development  phase 

(4)  ISD/JGD  program  -  production  phase 

1.  5  DEMONSTRATION  OBJECTIVES  AND  GUIDELINES 
The  specific  objectives  of  this  demonstration  are  to: 

A.  Determine  the  feasibility  of  applying  the  CHRT  and  the  CDB  in 
all  phases  of  weapon  system  acquisition. 

B.  Identify,  provide,  and  evalu  ate  the  utility  of  the  CHRT  products. 

C.  Determine  the  content  and  effectiveness  of  a  CDB. 

D.  Identify  and  correct  Inadequacies  and/or  inconsistencies  in  the 
CHRT  process  and  the  CDB. 

E.  Estimate  the  resources  required  to  apply  CHRT  with  a  CDB  versus 
the  five  individual  technologies  with  individual  data  bases. 

All  the  above  objectives  will  be  addressed  in  this  report  except  E. 
Upon  completion  of  the  total  demonstration,  personnel  records  will  be 
reviewed  to  determine  resources  required  to  apply  CHRT  and  to  develop 
and  maintain  a  CDB.  This  Information  will  then  be  included  in  the  final 
CHRT  report. 
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The  guidelines  imposed  on  the  demonstration  are  to  apply  CHRT 
on  the  avionics  and  landing  gear  systems  of  the  AMST  and  to  adapt  the 
CHRT  demonstration  to  the  AMST  program.  Since  both  the  conceptual 
and  validation  (prototype)  phases  of  the  AMST  program  were  complete 
when  this  demonstration  was  initiated,  it  was  necessary  to  simulate  the 
application  of  CHRT  in  those  phases.  Actual  historical  data  from  the 
conceptual  and  prototype  phases  of  the  AMST  program  were  used  for 
this  purpose.  It  was  important  to  limit  the  demonstration  to  typically 
available  data  in  order  to  draw  meaningful  conclusions  about  CHRT 
applicability  throughout  the  acquisition  cycle.  The  demonstration  of 
CHRT  during  the  AMST  full-scale  development  (minimum  engineering 
development)  phase  will  also  be  simulated  since  that  actual  activity 
is,  at  present,  indefinitely  delayed.  Typical  data  will  be  projected. 
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II.  DEMONSTRATION  IN  THE  CONCEPTUAL  PHASE 


2.  1  OVERVIEW 


The  demonstration  of  CURT  as  applied  in  the  conceptual  phase 
was  conducted  during  the  three  month  period  16  October  1977  to 
15  January  1978.  AMST  conceptual  phase  data  were  the  prime  source 
of  information.  HR  and  SOC  data  were  developed  on  four  baselines, 
two  for  avionics  and  two  for  landing  gear. 

The  results  indicated  that  the  conceptual  phase  application  of 
the  CURT  process  and  C1)B  was  feasible.  Only  actual  conceptual 
phase  source  data  supplemented  with  data  that  could  have  been 
obtained  in  the  conceptual  phase  was  used  and  proved  adequate  to 
support  CHRT  and  the  development  of  HR  and  SOC  estimates.  These 
estimates,  the  CHRT  conceptual  phase  products,  were  reviewed  and 
evaluated.  It  was  concluded  that  these  products  could  provide  signifi¬ 
cant  assistance  to  an  acquisition  manager  in  evaluating  alternative 
design,  operations,  maintenance,  and  support  approaches.  The  HR 
and  SOC  estimates  covered  broader  scope  and  provided  more  detail 
than  usually  available  at  tins  stage  of  acquisition.  These  data, 
derived  through  application  of  a  rigorous  and  rational  methodology, 
reflected  the  interrelationships  among  operations,  maintenance,  and 
logistics.  The  content  of  the  CDH  as  described  in  the  functional 
specification.  A FHRl.-TR-78-6(III),  was  adequate  and  effective  with 
minor  modification.  The  SOC  model  and  the  technique  used  to  reflect 
an  integrated  approach  to  personnel,  training,  and  technical  manuals 
were  identified  as  areas  for  improvements  which  were  then  initiated 
during  the  validation  phase  demonstration. 

2.  2  THE  AMST  CONCEPTUAL  PHASE  AND  DATA  SOURCES 

The  AMST  conceptual  phase  occurred  in  the  1972  time  frame. 
Three  contractors- -McDonnel  Douglas,  Lockheed-Georgia,  and 
North  American  Rockwell--participated  and  eventually  submitted 
conceptual  studies  covering  a  total  of  eight  airframe,  engine,  and  high 
lift  combinations.  Prior  to  the  completion  of  the  studies,  however, 
the  Air  Force  received  Department  of  Defense  direction  to  accelerate 
efforts  and  to  immediately  initiate  a  prototype  procurement.  As  a 
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result,  the  conceptual  phase  studies  were  empleted  but  delivered  after 
the  prototype  phase  began  and  the  studies  were  not  evaluated.  These 
conceptual  studies  were  retrieved  and  used  for  this  demonstration. 
Coupled  with  the  appropriate  version  of  the  Requirement  for  Operational 
Capability  (ROC),  they  provide  a  significant  portion  of  the  conceptual 
phase  data  required. 

CHRT  also  require  the  development  of  maintenance  action  net¬ 
works  in  the  conceptual  phase  through  a  comparability  analysis.  Since 
the  AMST  conceptual  phase  took  place  before  any  requirement  for 
maintenance  action  networks  was  established,  these  data  were  not 
directly  available.  A  generalized  AMST  maintenance  action  network 
had  been  developed  in  the  early  prototype  phase,  however.  This  network 
was  used  during  the  demonstration  as  conceptual  phase  data.  This  action 
was  justified  because  a  review  of  the  conceptual  studies  indicated  that 
comparability  was  well  enough  defined  by  those  studies  to  have  developed 
a  generalized  network  at  that  time. 

2.3  CHRT  RESULTS  -  CONCEPTUAL  PHASE 

The  results  of  the  CHRT  demonstration  are  presented  and  dis¬ 
cussed  under  the  following  topics: 

•  Has eline(s)  and  alternative(s) 

•  Reliability,  maintainability,  and  maintenance  manpower 

requirements 

•  Operations  manpower  requirements 

•  Scope  and  magnitude  of  training  and  technical  manuals  for 

maintenance  personnel 

•  Scope  of  training  for  operations  personnel 

•  SOC 

•  HR  and  SOC  impact  of  baseline(s)  and  alternative(s) 

•  High  drivers 

•  Training  and  technical  manual  products 

Data  developed  were  based  on  an  assumed  300  aircraft:  256  unit 
equipped  (UE)  and  44  not  operationally  available  (NOA).  It  was  also 
assumed  that  there  would  be  16  squadrons  and  one  training  squadron 
of  16  aircraft  each,  divided  among  four  Continental  United  States  (CONUS) 


ami  two  overseas  locations.  Aircrew/aircraft  ratio  per  UK  and  per 
NOA  used  for  training  is  2:1.  Utilization  rate  is  1.  5  hours/day  during 
a  5  day  week.  Samples  of  data  will  be  included  in  the  discussion, 
itself  when  appropriate.  A  data  supplement  is  provided  under  separate 
cover  as  Appendix  A  (Volume  II). 

Baseline(s)  and  Alternative(s) 

Potential  baselines  and  alternatives  for  equipment  configura¬ 
tion,  engineering  design,  and  operat ions,  maintenance,  and  support 
approaches  are  documented  in  ('1IRT  by  IX)l)Ts  and  alternative 
listings.  The  alternative  listing  contains  information  not  directly 
documented  by  a  DOl)T  such  as  payload  or  takeoff  field  length.  The 
information  required  to  develop  this  documentation  is  obtained  from 
designers,  engineering  data,  program  direction,  specifications,  and 
standards.  The  AMST  conceptual  phase  proposals  and  the  ROC  pro¬ 
vided  the  primary  source  data  m  this  case  along  with  an  equipment 
listing  from  the  original  AMST  comparability  analysis. 

Twelve  (12)  |)01>Ts  were  developed;  one  for  the  AMST 
system,  eight  for  avionics,  and  throe  for  landing  gear.  The  AMS’l 
system  l)Ol)T  is  presented  in  Figure  i».  A  major  alternative  directly 
affecting  system  design,  avionics  design,  and  operat  ions  manpower 
requirements  was  immediately  discernable  from  the  system  DODT  as 
well  as  the  alternative  listing.  This  alternative  is  the  three-man 
versus  four-man  crew  option  (i.o.,  pilot,  copilot,  and  loadmaster 
witnout  and  with  a  navigator).  A  more  intensive  review  of  all  the 
IX)DTs  resulted  in  the  identification  of  four  baseline  configurations 
for  consideration. 

•  Two-man  flight  deck(2MK!))avionics  (pilot  and  copilot) 

•  Three-man  flight  dec k(!M I  I))avtomcs  (pilot,  copilot, 
and  navigator) 

•  Modified  C-141  landing  gear 

•  New  landing  gear 

The  significant  difference  between  the  2MFI)and  3MFI) 
avionics  is  the  inclusion  of  processors,  control  integration,  unique 
displays,  and  integrated  instruments  in  the  2MFI)  version.  Portions 
of  the  avionics  !X3I)Ts  which  display  these  differences  are  shown  in 
Figure  7.  These  trees  are  annotated  2MFP  and/or  3MFD  to  indicate 
the  appropriateness  of  the  decision  block  to  the  design  option.  Un¬ 
annotated  blocks  indicate  that  they  are  appropriate  to  either  option. 
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A  modified  C-141  landing  gear  offered  commonality  and  thus 
reduced  support  requirements  over  a  new  landing  gear.  Technically, 
both  landing  gear  are  considered  comparable  at  this  phase  of  design 
and  no  significant  design  differences  are  noted.  Therefore,  only  one 
equipment  configuration  was  analyzed. 

A  listing  of  the  IXiDTs  developed  and  the  alternative  listing  is 
provided  in  Appendix  A  (Volume  II).  A  complete  set  will  be  provided 
with  the  report  documenting  the  demonstration  of  CHRT  and  the  CDB  in 
full-scale  development. 

Reliabillty(R),  Maintainability (M),  and  Maintenance  Manpower 
Requirements 

The  generalized  A  MST  maintenance  action  networks  obtained  from 
the  A  MST  System  Program  Office  (SIX'))  covered  the  baseline  configura¬ 
tions  identified  in  the  DODT  analyses.  These  networks  were  reviewed 
for  completeness  and  validity.  They  were  then  used  as  input  data  for 
the  RAM  model  (A  FHRF-TR- 78-2).  The  model  was  then  operated  and 
reliability,  maintainability,  and  maintenance  manpower  data  were  ob¬ 
tained  for  each  configuration.  The  reliability  and  maintainability  re¬ 
sults  calculated  for  the  3  MFD  avionics  and  2 MFD  avionics  are  presented 
in  Tables  1  and  2  respectively.  The  first  three  columns  of  Tables  1  and 
2  represent  the  CHRT  equipment  codes,  the  comparable  aircraft  systems, 
and  the  major  item  descriptors.  Some  common  abbreviations  used  with 
the  major  item  descriptors  are: 


HK 

high  frequency 

VOR 

visual  omni  range 

VHK 

very  high  frequency 

ILS 

instrument  landing 

FM 

frequency  modulation 

system 

AM 

amplitude  modulation 

LF 

low  frequency 

UHK 

ultra  high  frequency 

SKE 

station  keeping 

OF 

direction  finder 

equipment 

IFF 

interrogator  iriend  or  foe 

INS 

inertial  navigation 

TACAN 

tactical  air  navigation 

system 

system 

HUD 

heads  up  display 

CRT 

cathode  ray  tube 

The  remaining  columns  provide  measures  of  reliability  and  maintain¬ 
ability  which  are: 

AvU.biU.y  -  calculated  a. 

MFHBMA  -  man  flight  hours  between  maintenance  actions 
RAR  -  mean  remove  and  replace  time  on  the  flight  line  (hours) 
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MTTR  -  mean  time  to  repair  on  the  flight  line  (hours) 

MM II  -  mean  maintenance  manhours  to  repair  on  the  flight 
line  (hours) 

MMR  -  maintenance  men  required  to  effect  a  flight  line  repair 
which  is  calculated  as  MMII 

MTTR 

The  reliability  and  maintainability  results  for  the  landing  gear 
are  presented  in  Table  3.  Since  the  entire  landing  gear  configuration  is 
drawn  from  the  C-141,  the  comparable  subsystem  column  is  omitted. 
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Maintenance  manpower  requirements  are  determined  for  each 
A  ESC  in  terms  of  maintenance  manhours  per  thousand  flying  hours 
IMMH/KKH)  directly  from  the  RAM  model.  The  average  number  of 
men  required  per  squadron  for  each  A  ESC*  and  skill  level  is  determined 
from  the  following  formula. 

No  ,  (MMII/K1 H>(  1  H/Sq-YH)(VR/12  months) _ 

(Efficiency  factorMWork  days/monthHShift  hours/day) 


where: 


MMH/Kl'M  -  as  applicable  in  maintenance  hours/1000  flying  hours 

KH/SQ-YR  -  flying  hours/per  squadron-year  •  7488  flying  hours/ 
year 

YR/12  months  -  .083  year /months 
Efficiency  factor  1  .  6 
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Workdays/month  21.7  maintenance  days/month 
Shift  hours/dav  =  8  maintenance  hours/maintenance  day 


The  variables  KH/Sq-YR,  efficiency  factor,  work  days/month, 
and  shift  hours/day  represent  a  scenario.  The  scenario  used  for  this 
demonstration  was  L8  FH /aircraft- day,  16  a  ire  raft /squadron,  5  flying 
days/week,  .6  efficiency  factor,  21.7  work  days/month,  and  8  shift 
hours/work  day.  The  maintenance  manpower  requirements  for  this 
scenario  are  depicted  in  Table  -1  for  all  avionics  and  landing  gear  base¬ 
lines.  The  major  factor  not  considered  here  is  launch  rate.  (Note: 
the  R&  M  model  provides  an  average  value  prediction.  It  does  not 
consider  the  dynamics  of  the  situation  as  does  I. COM,  a  Monte  Carlo 
model. ) 
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Operations  Manpower  Requirements 

The  operations  manpower  requirements  for  an  aircraft  are 
relatively  straightforward  and  are  basically  expressed  in  crews  per 
aircraft.  This  factor  coupled  with  the  aircraft  phase-in  and  phase-out 
schedule  is  used  to  determine  lifetime  operational  manpower  require¬ 
ments.  Both  training  pipeline  and  operations  for  a  proposed  AMST  are 
depicted  in  Table  5. 
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Scope  and  Magnitude  of  Training  and  Technical  Manuals  for 
Maintenance  Personnel 


Inherent  in  CURT  is  the  treatment  of  training  and  job  guide 
documentation  as  an  interactive  pair  which  is  either  conventional 
(deductive)  or  task-oriented  (directive)  in  nature  (see  paragraph  1.2). 
The  CHRT  output  in  terms  of  HR  requirements  is  an  estimate  of 
training  course  length  and  technical  manual  page  quantity.  Page  quan¬ 
tities  are  further  categorized  into  flight  line  or  shop  and  into  trouble¬ 
shooting  and  non-troubleshooting.  The  source  data  for  these  estimates 
in  the  conceptual  phase  were  drawn  from  Air  Force  Career  Development 
training  course  content  and  the  comparable  system  equipment  technical 
manuals. 


Career  development  courses  exist  for  most  Al'SC's.  These 
course  lengths  and  the  course  material  presented  reflect  the  conven¬ 
tional  approach.  Course  content  generally  follows  the  outline  shown  in 
Table  6.  The  task-oriented  training  factors,  shown  in  parentheses 
opposite  the  conventional  course  outline  in  table  6,  are  used  to  adjust 
conventional  course  length  to  ask  oriented  course  length.  These  task- 
oriented  training  factors  were  developed  bv  behavioral  scientists  and 
are  based  on  a  knowledge  of  the  objectives  of  this  type  training  and  a 
review  of  the  literature  describing  this  training. 


CONVENTIONAL  COURSE  OUT  UN* 


TASK-ORIENTED 
TRAINING  FACTOR 


A.  Bus  principle!  10.20) 

B  General  information,  fundamental*,  and  adminittiation  - 

V  General  <0  961 

2.  Technical  publication*.  Paperwork  (1.10) 

3.  Maintenance  procedure!  (0.901 

C.  Applied  Principle!  - 

1.  General  (0.76) 

2  Specific  (1.00) 

3.  Teat  Equipment  (t  .20) 

O.  Equipment  related  lea  turn  (0.60) 

1.  Subayttem/LRU  - 

2.  LRU  component  - 

E.  kfoinia nance  requirement!  and  equipment  performance  (0.601 

1.  Standard*,  check*,  ad  putt  men  t*  - 

2.  TrowMeehoohnf  procedure*/ mpport  equipment  - 


Table  •  CONVENTIONAl/TASK-ORIENTEO  TRAINING  RELATIONSHIP 
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Course  length  for  the  task-oriented  approach  is  estimated  by 
multiplying  the  conventional  course  time  required  for  the  various 
topics  by  the  factors  shown  in  parentheses.  For  example,  the  task- 
oriented  approach  provides  little  theory  because  the  deductive 
reasoning  process  is  effectively  replaced  by  direction.  Therefore, 
the  time  allotted  to  "Basic  Principles"  is  only  20  percent  of  that  in  a 
conventional  course.  On  the  other  hand,  the  use  oi  directive  material 
and  test  equipment  is  more  heavily  emphasized  in  a  task-oriented 
course  than  in  a  conventional  course.  Therefore,  "Technical  publica¬ 
tions,  paperwork,"  and  "Test  Equipment"  are  more  heavily  empha¬ 
sized  in  task-oriented  training.  The  resulting  estimates  for  the  Air 
Force  career  development  courses  required  to  support  the  AMST 
avionics  and  landing  gear  are  shown  in  Table  7. 


Court*  length 


AFSC 

Tit!* 

Conventional 
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TaM*  7 

COURSE 

LENGTH 

Technical  manual  page  and  page  type  estimates  are  made  with 
specially  developed  algorithms.  A  separate  set  of  algorithms  is  re¬ 
quired  for  conventional  and  task-oriented  estimates.  Within  each  set, 
a  separate  algorithm  may  be  required  for  each  of  four  task  categories: 
non-troubleshooting  flight  line;  non-troubleshooting  sliop;  trouble¬ 
shooting  flight  line;  troubleshooting  shop.  Those  algorithms  may  also 
be  unique  to  an  equipment  category.  For  example  avionics  and  landing 
gear  are  technically  dissimilar  and  require  different  algorithms.  A 
flight  instrument /control  system  and  an  avionics  system  sre  similar 
and  would  sue  the  same  algorithms.  The  major  variables  in  each  of 
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these  algorithms  are  the  number  of  subsystems,  LRUs  and  SRUs  in 
a  system  and  the  types  of  maintenance  actions  required  to  support 
each  subsystem,  LRU  and  SRU. 


The  page  estimates  developed  during  the  conceptual  phase 
demonstration  are  shown  in  Table  8.  {Estimates  are  in  page  quantity 
and  were  developed  for  both  conventional  and  task-oriented  technical 
manuals.  For  each  type  manual,  page  estimates  were  further  broken 
down  into  non-t roubleshooting  (NTS)  and  troubleshooting  (TS)  for  both 
flight  line  (KL)  and  shop  (S).  The  algorithms  and  cost  data  which  are 
presented  in  Volume  II  address  the  additional  detail  level  of  page  type 
such  as  narrative,  action  page,  schematic  and  pictorial.  This  detail, 
however,  was  not  presented  tn  the  estimate  because  the  algorithms 
and  cost  data  were  drawn  from  too  limited  a  data  base.  This  data 
base  was  extended  during  the  validation  phase  demonstration  and  all 
algorithms  and  cost  data  were  improved. 
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Training  for  Operations  Personnel 

AMST  operator  course  length  was  derived  from  a  consideration 
of  a  comparable  training  course  for  the  C-130  crews,  equipment  per¬ 
formance,  avionics  options,  and  a  preliminary  operator  task  list.  The 
latter  was  derived  from  conceptual  phase  data  and  is  provided  in 
Volume  11.  It  identifies  those  tasks  unique  to  the  AMST.  The  unique 
tasks  are  flight  engineer  type  tasks,  which  must  now  be  assumed  by  the 
pilot  and  copilot,  and  navigator  tasks,  which  also  will  have  to  be 
assumed  by  the  pilot  and  copilot  if  the  two-man  flight  deck  concept  is 
implemented.  The  list  was  reviewed  against  the  C-130  course  schedule 
and  a  judgment  made  as  to  AMST  course  length  for  both  the  2MFD  and 
3MFD  options.  The  results  are  shown  in  Table  9. 
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SOCs  were  derived  as  appropriate  for  the  cost  categories 
listed  in  Table  10.  Some  cost  equations  used  were  original  while 
others  were  modified  and/or  drawn  from  t tie  Air  Force  Logistics 
Command  (AFLC)  Logistic  Support  Cost  Model  and  from  the  DAIS 
I  CC  study.  The  annual  cost  of  t tie  aircrew  (C^^-),  for  example, 
was  calculated  as  follows: 


C 


AC 


no.  of  crews 


-  (CPAMOA) 


P 

ZL 

p*  1 


cost  of  aircrew  man 

- . -  —  - 

(ABPK  *  YOSR  ♦  BAQ  ♦  ACI  *  BAS  ) 
P  P  P  p  p 


ABPR 

YOSR 

BAQ 

ACI 

BAS 

CPA 

OA 

P 

P 


-  annual  base  pay  rate 

•  years  of  service  pay  adder 

-  basic  allowance  for  quarters 
aviation  career  incentive  pay 

:  basic  allowance  for  subsistance 
r  number  of  crews  per  aircraft 

*  number  of  operational  aircraft  in  fleet 

-  subscript  identifying  the  pth  member  of  the  aircrew 

-  number  of  members  in  aircrew 


The  remaining  SOC  equations  used  are  provided  in  Volume  II. 
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Input  data  to  these  equations  are  categorized  as  either  standard 
or  unique.  Standard  data  cover  such  areas  as  salary,  training  costs, 
and  spares  pipeline  time.  Standard  data  are  drawn  from  officially  main¬ 
tained  sources  such  as  pay  and  allowance  tables  and  AFR  173-10.  Unique 
data  cover  the  HR  requirements  as  quantified  within  CURT  such  as 
maintenance  manpower  requirements.  Other  unique  factors  such  as 
equipment  quantities  and  delivery  schedule,  operational  applications, 
and  crew  makeup  are  drawn  from  system  related  sources  such  as  the 
comparability  analysis,  operations  plans,  and  system  specifications. 

The  AMST  unique  data  used  during  this  phase  of  the  CHRT  demonstration 
may  be  found  in  Volume  II. 

Annual  SOC  estimates  developed  from  CURT  application  with 
AMST  conceptual  data  arc  listed  in  Table  10. 
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3MFD 
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4.852.000 

496.000 

396.000 

Faolrtiet 

Aircrew 

18. 296.500 
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NA  -  not  applicable 
TBO  —  to  S#  determined 


Table  10  ANNUAL  SYSTEM  OWNERSHIP  COSTS 
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All  cost  categories  directly  associated  with  avionics  and  landing  gear 
have  been  covered  in  Table  10,  except  landing  gear  support  equipment. 
Data,  as  well  as  a  computational  method,  were  lacking  for  the  flight 
line  and  shop  landing  gear  support  equipment;  therefore,  these  costs 
are  noted  as  to  be  determined  (TBD).  The  support  equipment  costs 
for  avionics  are  for  shop  only.  Cost  categories  that  are  not  directly 
applicable  to  either  avionics  or  landing  gear  are  noted  as  N/A. 

It  should  also  be  noted  that  although  SOC  consists  of  both 
support  investment,  a  non- recurring  cost;  and  OiS  cost,  a  recurring 
cost;  both  have  been  treated  on  an  annual  basis.  Additionally,  some 
cost  categories  such  as  job  guides  and  training  should  have  both  a 
non- recur  ring  and  recurring  element,  Idas  lack  of  differentiation  was 
a  limitation  of  the  method  utilized  for  computing  costs  and  was 
corrected  in  the  validation  (prototype)  phase  demonstration.  Further¬ 
more,  the  research  and  development  aim  svstem  acquisition  costs 
must  be  identified  before  a  complete  cost  picture  can  be  presented  to 
the  decision  makers.  In  tins  case,  there  is  a  significant  difference  in 
acquisition  costs  for  the  2MFD  and  3MF1)  avionics.  This  difference 
while  not  documented  here  will  be  discussed  m  the  results  of  the 
validation  phase. 

HR  and  SOC  Impact  of  Hascline(s)  and  Alternauve(s) 

The  HR  and  SOC  data  developed  through  the  CURT  process  have 
now  been  presented  for  each  of  the  four  baselines.  To  be  used  effectively 
to  mvluence  the  selection  of  a  specific  baseline,  the  HR  and  SOC  data 
must  be  presented  in  a  format  which  facilitates  comparison.  In  any  case, 
HR  and  SOC  data  must  be  supplemented  with  appropriate  performance, 
risk,  acquisition  cost,  operations,  and  schedule  impact  data  before  a 
rational  decision  can  be  made.  This  portion  of  the  report  therefore  does 
not  address  decision  making,  hut  rather  the  presentation  to  the  decision 
maker  of  the  data  that  are  available  through  the  CURT  process. 

The  HR  and  SOC  impact  of  the  2MFD  versus  3MFD  avionics 
options  is  presented  in  various  formats  by  Tables  11,  12  and  13.  Each 
format  is  discussed  in  the  following  paragraphs. 

The  2MFI)  and  3MFD  avionics  options  share  a  significant  amount 
of  equipment  as  noted  in  Table  11.  The  major  difference  is  that  the 
2 MFD  configuration  includes  integrated  communication  and  navigation 
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controls  thus  eliminating  the  need  for  discrete  controls  and  incorpor¬ 
ates  a  multiple  CRT  display  capability.  A  mission  computer  coordin¬ 
ates  communications,  navigation,  and  display  callup  and  provides 
addiiional  computing  functions  which  ease  the  workload  on  the  reduced 
flight  deck  crew.  Table  11  compares  key  reliability  and  maintain¬ 
ability  related  data.  Specifically,  the  presentation  depicts  the  impact 
on  availability,  Ml'HBMA.  and  on  MMll/l'H  of  the  two  options.  One 
may  conclude  from  this  presentation  that  the  2MF1)  avionics  offers 
improved  availabilitv  and  reliability  (Ml'HBMA)  with  reduced  main¬ 
tenance  requirements  (MMll/l'H), 
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Iii  a  similar  manner.  Table  12  presents  the  maintenance  man¬ 
power  impact.  Overall,  nine  fewer  maintenance  men  are  required  to 
support  the  2  MFD  option. 
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TaMe  1?  MAINTENANCE  MANPOWER  IMPACT  IMEN  PER  SOUADRON) 

2MFD  vs  3MFD  AVIONICS 

The  S(K'  impact  is  presented  in  Figure  13  for  the  2\1KI)  versus 
3MFD.  The  advantage  is  to  the  2  Mi  l)  avionics  suite  maii.lv  because  of 
the  reduced  crew  and  maintenance  costs.  The  advantage  may  be  quanti¬ 
fied  in  terms  of  S(K’  as  514,  210,  000  per  year. 
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TabU  13  SYSTEM  OWNERSHIP  COST  IMPACT 
2MFD  r»  3MFO  AVIONICS 


No  significant  tcrhnu'.il  differences  ncrr  identifiable  between  a 
new  and  a  modified  landing  near  due  to  inadequate  design  definition.  A 
comnionalitv  factor  for  a  modified  ge<r  -<f  AO  per.  evf  nnrr.nn  parts  was 
assumed,  however.  The  liv.p.'u  t  >f  this  is,umpti<m  mas  be  discerned 
directly  from  a  previous  present. iti •>:  I' able  10,  V-nual  System  Owner 
ship  Costs.  The  impact  is  quantifiable  is  .1  pntenti  d  advantage  of 
?  1  2 5,  000 /year  for  a  modified  gear.  Alth  u,d.  an  advantage  to  using  a 
modified  gear  might  be  intuitively  as-ajp  *-,1,  t  quisition  costs  and  more 
detailed  design  data  are  needed  for  i  le.  isim;.  The  point  to  note  here 
is  that  the  CURT  process  will  quantify  a  fa<  tor  such  as  commonality. 

High  Drivers 

High  drivers  are  defined  within  <  HRT  as  areas  which  require 
excessive  HR  or  SOC.  Kxcessive  must  be  defined  bv  acquisition  manage¬ 
ment  so  that  HR  and  S(X’  data  may  then  be  screened  hv  some  established 
criteria.  Table  14  represents  a  technique  that  could  be  employed  for 
identifying  reliability  and  maintainability  related  high  drivers  in  the 
landing  gear  area. 
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GEAR 

Screening  values  and  assessment  factors  <e.  g.  ,  the  screening 
value  of  8.  5  for  the  assessment  factor  of  availability  shown  in  Table  14 
are  established  bv  the  user  or  acquisition  agency.  Only  those  assess¬ 
ment  factors  exceeding  the  screening  values  are  displayed  for  review. 

A  separate  presentation  is  provided  for  each  equipment  configuration. 

A  review  of  Table  14  indicates  that  based  on  comparability  data, 
the  brakes/anti- skid  subsystem  of  the  landing  gear  and  the  general 
area  of  mean  time  to  repair  for  the  total  landing  gear  system  are  likely 
to  be  high  drivers  for  a  141  type  landing  gear  since  they  exceed  the 
screening  values  established.  If  a  iodified  ('-141  gear  was  chosen, 
immediate  action  should  be  taken  to  specifically  determine  the  reliability 
and  maintainability  problems  associated  with  the  brakes /anti- skid  sub¬ 
system.  Since  both  the  new  or  modified  gear  represent  the  same  basic 
technology,  one  might  investigate  the  reasons  behind  the  high  MTTR 
or  even  question  the  screening  value.  A  possible  conclusion  is  that 
considerable  time  is  required  in  jacking  the  aircraft.  The  problem, 
therefore,  may  not  be  with  the  aircraft  itself,  but  with  support  equip¬ 
ment.  In  either  case,  alternatives  might  have  to  be  considered  and 
their  impact  in  terms  of  HR  and  S(X'  determined  through  a  reiteration  of 
CURT. 
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'High  drivers'1  were  also  identified  for  both  avionics  options. 
These  are  depicted  m  Tables  15  and  16.  The  avionics  data  represent 
actual  field  experience  with  the  same  off  the -shelf  avionics  equipment 
being  considered  for  the  AMST.  Since  so  many  assessment  factors 
exceed  the  screening  value,  further  investigation  is  mandatory.  The 
comparability  association  should  first  be  verified  and  data  corrected 
as  necessary.  If  excessive  assessment  factors  still  exist,  the  cause 
for  the  unacceptable  performance  should  then  be  identified.  In  this 
case,  the  screening  values  assigned  were  drawn  from  the  AMST  ROC. 
Possible  causes  include  poor  technical  design,  difficult  access  on  the 
comparable  aircraft  system,  inadequate  training  or  technical  manuals 
or  incompatible  support  procedures.  Once  a  potential  corrective  action 
is  identified,  it  can  be  reevaluated  through  the  CURT  process.  The 
user  should  also  consider  reducing  requirements  (screening  values) 
where  possible. 
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Training  and  Technical  Manual  Products 

The  planned  product  for  the  conceptual  phase  was  an  integrated 
personnel,  training,  and  technical  manual  concept.  In  addition  to 
estimating  the  length  of  training  and  number  of  technical  manual  pages, 
as  was  accomplished,  another  goal  was  to  identify  required  levels  of 
detail  and  depth  of  coverage  in  both  technical  manuals  and  training  for 
the  integrated  personnel,  training,  and  technical  manual  approach 
desired.  This  identification  was  to  be  accomplished  through  a  task 
intensity  profile  developed  using  the  It  A.  M  model  output.  A  technique  to 
accomplish  this  was  developed  and  implemented. 

A  review  of  the  technique  and  results,  however,  indicated  an 
incompatabilitv  in  the  comparability  data  input  to  the  R&  M  model. 

These  data  had  not  been  normalized  to  represent  the  desired  integrated 
personnel,  training,  and  technical  manual  concept.  Specifically,  the 
input  data  drawn  from  technically  comparable  systems  was  not  logis- 
ticallv  comparable.  The  systems  were  maintained  and  supported  by 


various  skill  levels,  types  of  training  and  both  deductive  and  directive 
technical  manuals.  These  data  should  have  been  normalized  to  the 
integrated  approach  selected  for  the  equipment  under  consideration. 

This  shortcoming  was  noted  and  has  since  been  corrected.  The  new 
analysis  technique  is  discussed  in  Section  III  of  this  report. 

The  actual  training  and  technical  manual  product  developed  in  this 
phase  of  the  demonstration  was  a  description  of  the  prescribed  AMST 
personnel,  training,  and  technical  manual  concept.  This  concept 
addresses  basically  5-skill-level  manning,  conventional  training,  and 
task-oriented  technical  manuals.  Because  of  the  combined  conventional 
and  task-oriented  nature  of  the  three  elements,  this  concept  cannot  be 
considered  an  integrated  approach. 

2.4  CONCLUSIONS  -  CONCEPTUAL  PHASE 

Overall,  this  phase  of  the  CHRT  demonstration  has  shown  that 
extensive  HR  and  SOC  data  can  be  developed  and  quantified  for  a  weapon 
system  acquisition  program  through  a  rational,  repeatable  and  traceable 
process  as  early  as  the  conceptual  phase.  More  specifically,  the  con¬ 
clusions  are: 

A.  Application  of  the  CHRT  process  and  the  CDB  is  feasible  in  the 

conceptual  phase. 

1.  The  RAM  model  is  adequate  for  estimating  maintenance 
manpower  requirements  and  reliability  and  maintainability 
data. 

2.  The  techniques  used  for  estimating  operations  manpower  and 
operations  and  maintenance  course  length  are  at  least 
adequate  for  conceptual  phase  estimates. 

3.  The  CHRT  process  appears  well  suited  to  address  the  question 
of  affordability  of  alternatives  at  their  conceptual  development 
stage. 
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The  conceptual  phase  CHRT  products  have  been  identified  and 

representative  samples  have  been  provided  and  evaluated  for 

utility. 

1.  The  CURT  products  in  the  conceptual  phase  are  HR  and  SOC 
estimates  for  system  and  subsystem  alternatives.  The  HR 
estimates  include  reliability,  maintainability,  maintenance 
manpower,  training,  and  technical  manuals  for  maintenance, 
operations  manpower,  and  training  requirements  for 
operations, 

2.  The  CHRT  process  considers  and  these  estimates  uniquely 
reflect  the  interrelationship  among  the  design,  logistic, 

and  operational  elements  of  the  weapon  system.  This  occurs 
because  these  elements  are  characteristics  of  the  mainten¬ 
ance  action  networks  from  which  CHRT  estimates  are  de¬ 
rived. 

3.  The  information  and  visibility  provided  by  these  estimates 
can  be  used  to  more  effectively  manage  an  acquisition  pro¬ 
gram.  support  decision  making,  identify  potential  problem 
areas,  and  detail  the  information  necessary  for  DSARC  re¬ 
views.  This  is  possible  because  the  HR  and  SOC  estimate 
presents  a  concise  impact  statement  related  to  a  specific 
design,  logistics,  and/or  operations  approach.  Further¬ 
more.  this  statement  may  be  modified  through  the  CHRT 
process  to  reflect  the  impact  of  an  alternate  approach  in 
one  or  more  of  the  three  areas  mentioned. 

4.  The  estimates  do  facilitate  comparison  of  alternatives  and 
allow  identification  of  "high  drivers.  " 

5.  High  driver"  and  comparison  formats  should  continue  to 
be  evaluated  for  improved  presentation  of  HR  and  SOC  data. 

The  CDB,  as  conceived,  supports  the  CHRT  process  with  minor 

exceptions. 

1.  The  content  and  format  of  the  CDB  will  remain  subject  to 
change  until  the  completion  of  this  demonstration.  In  this 


way,  it  may  be  uniquely  and  efficiently  tailored  to  support 
the  total  CHRT  process. 

2.  The  analytic  tools  to  support  derivation  of  the  CHRT  pro¬ 
ducts  must  be  part  of  this  CDB  because  they  are  as  impor¬ 
tant  to  the  process  as  the  input  information. 

3.  Estimates  related  to  several  technologies  can  be  developed 
from  a  single  data  source. 

Inadequacies  and/or  inconsistencies  in  the  CHRT  process  and  the 

CDB  have  been  identified.  All  have  either  been  corrected  or 

earmarked  for  future  consideration. 

1.  Each  equipment  baseline  and  alternative  must  include  a 
specific  support  concept.  The  latter  has  direct  effect  on 
HR  requirements  and  system  ownership  cost. 

2.  The  comparability  analysis  required  for  the  development  of 
maintenance  action  networks  must  address  the  support  de¬ 
sign,  particularly  personnel,  training,  and  technical 
manuals,  as  well  as  the  system  design  so  that  HR  and  SOC 
estimates  may  reflect  the  characteristics  of  the  total  system. 

3.  In  addition  to  career  development  training,  both  technical 
training  and  on-the-job  training  should  also  be  addressed  in 
order  to  reflect  the  complete  training  picture. 

4.  Although  adequate  for  the  conceptual  phase,  job  guide  con¬ 
tent  algorithms  and  available  cost  data  must  be  improved  in 
accuracy  for  validation  (prototype!  phase  estimates. 

5.  SOC  equations  must  be  improved  for  a  finer  breakdown  of 
categories  and  separation  of  non- recurring  and  recurring 
costs.  Phase-in  and  phase-out  capability  should  be  developed 
so  multiple- year  costs  may  be  shown.  These  capabilities 
when  developed  may  be  applied  in  the  conceptual  phase. 
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in.  DEMONSTRATION  IN  THE  VALIDATION  PHASE 


3.  1  OVERVIEW 


The  demonstration  of  CURT  as  applied  in  the  validation  phase 
wqs  conducted  during  the  6  month  period  16  January  1978  to  15  July  1978. 
AMST  prototype  phase  data  were  the  prime  source  of  information.  The 
kind  and  quality  of  data  available  for  use  with  CHRT  in  the  avionics  and 
landing  gear  area  were  typical  of  data  available  for  use  in  the  validation 
phase.  Three  of  the  four  configurations  identified  in  the  conceptual 
phase  were  carried  forward  for  continued  analysis.  These  were  the  2MFD 
and  3 MFD  avionics  and  the  modified  C-141  landing  gear.  An  additional 
avionics  alternative,  integrated  digital  avionics  for  AN1ST  (IDAMST)  was 
also  identified  for  consideration.  During  this  phase,  a  technique  was 
implemented  to  reflect  in  the  maintenance  action  networks  an  integrated 
personnel,  training,  and  technical  manual  approach  to  either  a  conventional 
or  task-oriented  support  program.  Therefore  both  conventional  and  task 
oriented  support  programs  were  also  considered  as  options. 

The  results  of  this  phase  indicate  that  the  CHRT  process  and  CDB 
have  continued  and  extended  application  during  the  validation  phase.  HR 
and  SOC  estimates  were  again  developed  for  all  baselines  and  alternatives 
identified.  These  data  were  now  more  accurate  reflections  of  the  logis¬ 
tic  requirements  for  two  reasons.  One,  improved  technical  manual  con¬ 
tent  algorithms,  more  accurate  technical  manual  cost  data  and  updated 
SOC  equations  were  developed  for  and  employed  in  this  phase.  Two.  the 
integrated  approach  to  personnel,  training,  and  technical  manuals  re¬ 
flected  in  the  input  data  produced  a  coordinated  set  of  personnel,  training, 
and  technical  manual  requirements.  Additionally,  the  CHRT  process  was 
used  for  the  first  time  to  evaluate  a  major  piece  of  equipment  within  a 
subsystem,  thus  taking  advantage  of  the  additional  detail  available  in  the 
validation  phase. 

The  HR  data  derived  were  also  used  as  a  direct  input  to  a  pro¬ 
posed  Integrated  Personnel,  Training,  and  Job  Guide  '  Section  of  the 
AMST  Integrated  Logistic  Support  Plan  (ILSP).  This  document  presents 
a  realistic  level  of  detail  not  previously  available  in  an  ILSP  developed 
from  validation  phase  data.  A  newly  developed  CHRT  product  of  this 
phase  was  also  included  in  this  ILSP  section.  This  product  is  called  a 
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task  identification  matrix  and  was  developed  for  each  subsystem.  The 
matrix  describes  within  a  given  subsystem  and  for  a  specific 
personnel  training  and  technical  manual  approach,  the  degree  of 
emphasis  required  in  both  the  training  and  technical  manual  areas  for 
various  items  of  hardware. 

During  this  part  of  the  demonstration,  the  CDB  was  updated  for 
accuracy  and  expand,  d  in  detail  and  content.  The  additional  detail  re¬ 
flected  design  maturity  and  a  more  detailed  equipment  description.  The 
content  was  expanded  to  include  an  improved  SOC  model,  the  task  intensity 
matrix,  and  additional  support  data. 

3.2  AM  ST  PROTOT\  PE  PHASE  AND  SUI’Pl.EM  ENTAHY  DATA 

SOURCES 


The  AMST  prototype  phase  occurred  during  1976  and  1977.  Two 
contractors,  Boeing  and  McDonnell  Douglas,  participated.  Each  proposed 
a  singular  and  unique  design.  Both  proposals  were  available  as  source 
data  for  CURT  and  were  thoroughly  reviewed.  The  applicable  ROC  and 
Employment  Cone  ept  IV  icument  were  used  as  the  prime  sources  of  supple¬ 
mentary  data. 

Two  prototypes  of  each  design  were  built.  They  were  evaluated  by 
the  Air  Force,  primarily,  for  technical  and  operational  performance. 
Although  more  hardware  oriented  than  a  typical  validation  phase,  the 
AMST  prototype  phase  pursued  basic  validation  phase  goals.  These  were 
validation  of  the  technical  approach  and  reduction  of  technical  risk.  The 
AMST  prototype  phase  achieved  these  goals  through  extensive  hardware 
development. 

The  quality  of  avionics  and  landing  gear  data,  however,  was 
typic  al  of  validation  phase.  Very  little  actual  hardware  derived  data 
were  developed  for  these  systems.  Avionics  were  to  be  predominantly 
government  furnished  equipment  (GEE'  ard  were  not  a  major  contractor 
concern.  The  landing  gear  was  being  evaluated  primarily  for  performance 
and  verv  little  descriptive  or  maintenance  data  were  gathered. 

The  major  sources  of  avionics  information  during  this  phase  were 
several  studies  accomplished  bv  the  Aeronautical  Systems  Division,  the 
Air  Force  Avionics  l  aboratory,  and  the  Air  l  orce  Flight  Dynamics 
Laboratory.  All  studies  are  excellent  examples  of  the  depth  of  inves¬ 
tigation  possible  in  the  validation  phase. 
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Design  and  maintenance  data  for  the  individual  landing  gear 
systems  proposed  by  each  contractor  were  documented  in  a  prototype 
phase  comparability  analysis  and  associated  maintenance  action  networks. 
These  data,  however,  were  part  of  the  minimum  engineering  develop¬ 
ment  (MED)  phase  proposals.  Asa  result,  these  data  were  considered 
source  selection  sensitive  and  were  not  made  available  for  this  study. 

As  an  alternative,  therefore,  the  conceptual  phase  generic  AMST  com¬ 
parability  analysis  and  maintenance  action  networks  were  updated  using 
the  prototype  phase  avionics  studies  and  1976  time  frame,  C-141  landing 
gear  maintenance  data  drawn  from  I’SAK  Logistic  Support  Cost  Kile 
Maintenance  Register-66- 1 /1HOS,  K051.  PN8L.  Both  these  sources  pro¬ 
vided  the  level  of  detail  data  appropriate  to  the  validation  phase. 

3.3  CHRT  RESULT  -  VALIDATION  (PROTOTYPE)  PHASE 

The  results  of  the  CHRT  demonstration  are  presented  and  dis¬ 
cussed  under  the  following  topics: 

•  Baselinc(s)  and  alternativ c»s) 

•  Reliability,  maintainability,  and  maintenance  manpower 

requirements 

•  Operations  manpower  requirements 

•  Scope  and  magnitude  of  training  and  technical  manuals 

for  maintenance  personnel 

•  Scope  of  training  for  operations  personnel 

•  S<  K‘ 

•  HR  and  SOC  impact  of  baselme(s)  and  alternati ce(s) 

•  High  drivers 

•  Training  and  technical  manual  products 

Samples  of  data  will  continue  to  be  included  in  the  discussion  or 
in  Volume  II  as  appropriate.  The  data  developed  were  based  on  the  ROC 
current  at  that  time  which  assumed  377  aircraft:  256  PE;  and  21  NOA. 
Sixteen  operational  squadron  were  split  between  two  overseas  locations. 
The  training  squadron  was  located  at  one  of  the  CONI’S  bases.  Air¬ 
crew/aircraft  ratio  was  2:1  per  LE  and  per  NOA  used  for  training. 
Utilization  rate  was  1.8  hours /day  during  a  5  day  week. 


Baseline(s)  and  Alternative's) 


The  first  step  accomplished  in  the  prototype  phase  was  to  update 
the  DODTs  and  alternative  listings.  The  AMST  system,  general  avionics, 
and  general  landing  gear  DODTs,  as  updated  to  the  prototype  phase,  are 
included  in  Volume  II.  Additionally,  a  DODT  was  developed  for  alternative 
logistic  options.  This  is  shown  in  Figure  8  and  depicts  the  possible  alter¬ 
natives  in  support  equipment,  maintenance/personnel/training/ job  guide 
approach,  and  spares  philosophy.  The  logistics  tree's  blocks  are  anno¬ 
tated  with  a  (’  or  T  to  reflect  the  appropriate  paths  for  either  a  conven- 
tional(C)or  a  task-oriented (T)  personnel/training/ job  guide  approach. 

The  maintenance,  operations,  and  support  alternatives  not  directly 
discernible  from  the  DODTs  but  identified  in  the  prototype  phase  documen¬ 
tation  were  documented  in  the  alternative  listing  as  follows: 

•  2MFD  versus  3 MFD  crew 

•  l  imited  adverse  weather  aerial  delivery  system  (AWADS) 

•  Aircraft  radius  of  action 

•  Payload 

•  STOI.  field  length 

•  Runway  quality 

The  information  required  to  develop  and/or  update  the  DODTs 
and  the  alternative  listing  was  obtained  from  the  Boeing  YC-14  and 
McDonnell  Douglas  YC-I5  prototype  proposals,  the  Air  Force  avionics 
studies,  and  C-  141  technical  data.  A  review  of  the  DODTs  and  the  alter¬ 
native  listing  resulted  in  the  identification  of  three  baselines  and  five 
alternatives.  The  baseline  configurations  were: 

•  2MFI)  avionics  conventional  ISD/JGD 

•  Modified  (*  - 141  landing  gear  -  conventional  ISD/JGD 

•  Installed  stati  -  keeping  equipment 

The  alternatives  identified  were: 

•  2MFD  avionics  -  task-oriented  ISD/.1GD 

•  3 MFD  avionic  s  -  conv  ntional  ISD/JGD 

•  IDAMST  -  conventional  ISD/JGI) 

•  Modified  C-141  landing  gear  -  task-oriented  ISD/JGD 

•  Insertable  station- keeping  equipment 
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DESIQN  OPTION  QECUION  TREE  FOR  LOO  1ST  ICS 


The  two  and  three  man  avionics  suites  are  basically  the  same  con¬ 
figurations  addressed  previously  but  at  u  more  detailed  level. 

IDA.MST  is  a  digital  system  for  two  man  operation.  The  landing  gear 
is  considered  a  modified  1-141  type.  Although  the  VC-14  and  YC-15 
incorporate  different  designs,  both  represent  similar  technology  and 
utilize  portions  of  existing  designs.  The  more  detailed  design 
differences  are  shown  in  Figure  9.  Portions  of  the  main  and  nose 
gear  design  option  decision  trees  are  reproduced  in  this  figure  and 
annotated  C-14  or  C-15  at  the  bench-point  of  the  design  difference. 
The  conventional  and  task-oriented  ISD/JGD  approaches  can  also  be 
realistically  considered  as  alternatives  since  each  approach  may  be 
reflected  in  the  maintenance  action  network  input  data,  f  inally,  a 
subsystem  level  alternative,  msertable  SKK  was  selected.  SKK 
makes  up  a  portion  of  the  adverse  weather  aerial  delivery  system 
(AWADS).  Insertable  SKK  addresses  the  alternative  listing  item  of 
limited  AWAPS.  The  msertable  approach  is  feasible  since  AWADS  is 
required  only  on  selected  flights.  Insertable  SKK,  therefore, 
theoretically  represents  a  way  to  reduce  life  cycle  costs  since  a 
reduced  number  of  units  would  be  required  and  less  maintenance 
would  be  anticipated. 

Reliability  (H).  Maintainability  (M).  and  Maintenance  Manpower 
Requirements 

The  AM  ST  comparability  analysis  and  maintenance  action  net¬ 
works  for  the  subsystems  addressed  in  the  conceptual  phase  were 
updated  to  reflect  the  more  detailed  design  data  and  improved  infor¬ 
mation  available  in  the  prototype  phase.  These  subsystems  were  the 
2MKP  and  3MFD  avionics  and  the  modified  C-141  landing  gear. 
Additionally,  a  new  configuration  and  a  network  were  prepared  for 
the  IPAMST  option.  All  networks  were  prepared  to  reflect  a  rather 
traditional  or  conventional  approach  to  personnel,  training,  and  job 
guides.  Specifically,  this  was  S-sktll-level  manning  supported  by  3- 
skill-level  helpers,  conventional  training,  and  conventional  technical 
orders.  An  additional  set  of  maintenance  action  networks  reflecting  a 
task-oriented  option  was  also  developed  for  the  2\11*'D  avionics  and 
the  modified  C-141  landing  gear. 

Tables  17  and  18  present  the  R/tM  summaries  for  the  3MFD 
avionics  and  the  IDA M ST  avionics,  respectively.  Both  configurations 
reflect  the  conventional  approach  to  personnel,  training,  and 
technical  manuals.  The  3MFD  configuration  represents  a  simple 
avionics  suite  composed  of  discrete  off-the-shelf  components  with 
discrete  displays  and  controls.  The  IDAMST  on  the  other  hand 
represents  a  very  sophisticated  and  totally  integrated  conceptual 
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system.  Although  the  basic  sensors  found  m  the  3 MFD  are  retained  in 
IDAMST,  the  discrete  controls  and  displays  are  eliminated.  The 
elimination  of  these  discrete  controls  and  displays  accounts  for  in¬ 
creases  in  both  availability  and  MFHBMA  of  the  individual  items  in 
t tie  IDAMST  configuration.  In  the  IDAMST.  a  highly  reliable  pro¬ 
cessor,  core,  display,  and  control  group  provide  integration  and 
replace  the  discrete  displays  and  controls  of  the  3MFD  avionics.  For 
example,  the  availability  of  the  VHF/AM  radio  in  the  IDAMST  in¬ 
creases  to  .9690  from  .9528  in  the  3MFD  avionics.  This  is  because 
the  discrete  mechanical  control  has  been  eliminated  and  replaced  by 
the  electronic  control  group  which  has  a  very  high  reliability. 

Before  presenting  tin*  additional  results,  it  is  appropriate  to 
list  the  very  conservative  actions  taken  to  reflect  the  3-skill-level, 
task-oriented  ISD/JGD  approach  in  updating  maintenance  action  net¬ 
works.  The  rationale  for  each  action  is  provided  in  parentheses 
following  the  description  of  the  action.  The  statement  of  the  rationale 
is  substantiated  by  a  thorough  review  of  the  literature  which 
addresses  the  implications  of  task-oriented  training  as  supported  by 
proceduralized  aids.  The  actions  and  rationales  are  as  follows.  The 
percentages  used  are  representative  of  conclusions  found  in  the 
literature. 

(1)  Reduce  the  times  for  flight  line  cannot -duplicate, 
troubleshoot,  and  maintain  on  aircraft  by  10  percent 
each.  (Proceduralized  aids  reduce  maintenance  times.) 

(2)  Reduce  flight  line  probability  of  cannot -duplicate  by  50 
percent  and  reduce  the  number  of  cannot -duplicate 
actions  accordingly.  (Proeeduralized  aids  will  increase 
possibility  of  first  time  diagnosis,  ) 

(d)  Increase  MFHBMA,  as  appropriate,  based  on  action  (2) 
above. 

(4)  Reduce  shop  probability  of  cannot -duplicate  by  50  percent 
and  reduce  the  number  of  flight  line  remove  and  replace 
actions  accordingly.  (Proceduralized  aids  reduce  false 
removals.  ) 

(5)  Increase  the  number  of  flight  line  cannot -duplicate 
actions  by  the  same  numbrr  as  action  (4)  to  reflect  early 
cannot -duplicate  determination.  (Proceduralized  aids 
reduce  false  removals.  ) 
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(6)  Retain  personnel  quantit  and  AFSC  skills,  but  modify 

Skill  levels  as  follows: 

(a)  Assure  that  one  AFSC  41.3X1  position  is  always  a  5- 
skill-level  to  provide  supervision. 

(b)  Assure  that  all  shop  personnel  called  to  flight  line 
are  5-skill-level  (no  reduction  in  sliip  skills  is 
assumed  for  this  study). 

(c)  Set  all  flight  line  specialists  performing  eannot- 
duplicate,  troubleshooting,  and  remove  and  replace 
tasks  at  the  3-skill-level  (procedurali/.ed  aids  allow 
jobs  to  be  performed  by  lesser  skills). 

(d)  For  maintain  on  aircraft  actions  and  each  AFSC 
involved,  set  one  specialist  at  the  5-skill-level  and 
all  others  of  the  same  AFSC  at  the  3-skill-level. 
(Maintain  on  aircraft  is  assumed  to  be  a  more 
difficult  and  complex  action.  Therefore,  skills  can¬ 
not  be  reduced. ) 

Tables  19  and  20  present  the  RAM  summaries  for  the  conven¬ 
tional  and  task-oriented  options  with  the  2\1FL)  avionics.  Some  inte¬ 
gration  of  controls  and  displays  is  also  provided  in  the  2MFD 
avionics  but  not  to  the  same  degree  as  IDAMST.  The  integration  here 
is  represented  by  the  integrated  communications  control,  the  integra¬ 
ted  navigation  control,  the  integrated  navigation  signal  converter,  the 
mission  computer,  the  three  CRTs,  and  a  digital  scan  converter. 
Processing  and  core,  however,  are  held  to  a  minimum. 

The  primary  goal  in  the  2MFI)  avionics  design  is  to  reduce  in¬ 
flight  workload  for  compatibility  with  both  the  expected  mission  and  a 
limited  flight  deck  crew.  The  object  of  the  comparison  of  Tables  19 
and  20  is  to  consider  the  impact  of  a  logistic  alternative,  the  conven¬ 
tional  versus  task-oriented  approach.  A  comparison  of  Table  19  with 
Table  17  or  18,  on  the  other  hand,  facilitates  the  evaluation  of  a 
design  alternative. 

In  comparing  the  task-oriented  approach  to  the  conventional 
approach  for  the  2MFD  avionics  and  also  for  the  landing  gear 
(Tables  21  and  22),  the  reader  should  note  that  the  assumed 
advantages  of  the  task-oriented  approach  have  been  appropriately 
quantified.  Availability  increases,  MFHBMA  increases,  MTTR 
decreases,  and  MMIl/FH  decreases.  Other  logistic  alternatives 
could  be  quantified  in  a  similar  manner  given  the  initial  assumed 
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advantages  and  disadvantages  of  each  approach.  CHRT  does  not  make 
decisions  it  is  simply  used  to  quantify  the  impact  of  design  and 
support  alternatives.  In  doing  so,  it  uses  the  best  available  informa¬ 
tion.  The  result  must  therefore  be  considered  in  that  light. 
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TaMe  22  RftM  SUMMARY  -  MOOIFIED  LANDING  GEAR 
TaafcOnantad  Manning.  Training,  and  Tecfc  Manual! 


Maintenance  manpower  requirements  at  the  squadron  level 
were  determined  using  the  technique  described  in  Section  11.  These 
requirements  are  depicted  for  avionics  in  J able  23  and  for  landing 
gear  in  Table  24.  The  equipment  configuration  and  personnel /training/ 
tech  manual  approach  are  noted.  In  Table  23,  for  example,  a  different 
manpower  requirement  is  associated  with  each  avionics  configuration. 
A  review  of  this  data  with  reference  to  conceptual  phase  data  (see 
Table  4  )  indicates  results  ot  similar  magnitude.  Both  2MFD  and 
3MFD  avionics  with  the  conventional  option,  however,  now  show  a 
reduction  in  manpower  requirements. 
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Additionally,  the  conceptual  phase  conclusion  that  the  3MFD 
would  require  more  maintenance  personnel  than  the  2MFD  is  no 
longer  supported.  This  contradition  cannot  be  fully  explained.  It  may 
be  due  to  the  availability  of  more  detailed  and  more  accurate  data  in 
the  validation  phase,  with  the  validation  phase  results  being  the  "true" 
information.  It  may  be  due  to  random  variations  of  data  from  one 
analysis  to  another,  with  the  difference  between  results  not 
significant.  Furthermore,  the  issue  is  confounded  when  it  is  noted  in 
Table  23  that  use  of  the  task-oriented  approach  in  the  validation  phase 
reduces  2MFD  personnel  requirements  to  less  than  those  for  the 
3MFD,  thus  reasserting  the  conceptual  phase  results  that  the  3MFD 
requires  more  maintenance  personnel.  It  is  obvious  that  research  is 
needed  to  clarify  this  topic  and  to  determine  the  validity  of  early  pre¬ 
dictions  of  manpower  requirements. 

The  subsystem  level  alternative  of  fixed  versus  insertable 
SKE  was  also  addressed  during  this  phase  of  the  demonstration.  The 
objective  here  was  twofold.  First  was  the  development  of  the  technique 
to  both  isolate  a  single  subsystem  from  a  system  maintenance  net¬ 
work  and  then  address  this  subsystem  and  its  alternatives  in  terms  of 
both  scheduled  and  unscheduled  maintenance.  Second  was  the  evalua¬ 
tion  01  the  specific  SHE  alternative  described.  Both  of  these  objectives 
were  achieved. 

The  network  reflecting  unscheduled  maintenance  on  the  fixed 
SKE  (Figure  10)  was  stripped  from  the  2MFD  avionics  and  was 
independently  assessed  to  quantify  reliability,  maintainability,  and 
maintenance  manpower  requirements.  This  network  was  then 
modified  to  reflect  SKE  which  was  inserted  only  on  flights  having  an 
SKE  requirement.  It  was  assumed  that  half  of  the  flights  would  have 
an  SKE  requirement.  The  original  unscheduled  maintenance  network 
was  modified  to  reflect  this  50  percent  use  factor  by  reducing  the 
probability  of  subsystem  failure  in  the  original  network  by  one  half. 
This  results  in  an  increase  in  MFHBMA  from  26.3  to  52.6.  The 
modified  unscheduled  maintenance  network  is  shown  in  Figure  11  and 
reflects  this  single  change. 

A  scheduled  maintenance  network  (Figure  12)  was  then 
developed  to  reflect  the  time  required  to  insert  and  remove  SKE  on 
those  flights  for  which  it  was  required.  The  personnel  quantity, 
skills,  and  skill  levels,  and  times  required  for  unscheduled  removal 
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and  replacement  and  shop  were  used  for  scheduled  insertion  and 
removal  and  shop  checkout.  The  resulting  networks  were  then  assess- 
ed  to  quantify  reliability,  maintainability,  and  maintenance  manpower 
requirements  for  the  insertable  alternative.  The  scheduled  mainte¬ 
nance  rate  is  described  through  the  MFHBMA  factor.  In  this  case 
average  sortie  length  was  assumed  at  one  hour.  Since  the  SKE  would 
be  required  on  every  other  flight,  the  MFHBMA  for  insertion  and 
removal  is  two  hours. 

The  impact  of  this  alternative  was  surprising.  An  insertable 
SKE  would  require  a  tenfold  increase  in  SKE  support  personnel. 
Analysts  of  the  data  revealed  that  this  manpower  requirement  was 
directly  due  to  the  time  required  for  insertion  and  removal  effort. 

This  effort,  as  calculated,  completely  negated  any  maintenance  man¬ 
power  reduction  due  to  reduced  unscheduled  maintenance.  The  next 
step  would  be  to  investigate  and  verify  input  data,  such  as  insertion 
frequency  and  the  insert  and  removal  time,  is  the  time  representative? 
Could  the  time,  skills,  and  personnel  required  for  insertion  and 
removal  be  reduced  by  improved  training  or  technical  data?  Is  there 
an  equipment  access  or  location  problem  that  could  be  solved  by  re¬ 
design  or  relocation?  After  these  questions  were  answered,  a  new 
alternative  could  be  described  and  evaluated. 

In  this  case  it  was  found  that  the  scheduled  maintenance  rate 
should  have  been  10  hours  rather  than  two  hours.  The  average  flight 
is  assumed  to  be  five  hours  and  consists  of  five  sorties.  It  is  on 
every  other  flight,  not  sortie,  that  SKE  is  inserted.  More  correctly, 
SKE  support  personnel  would  have  to  double  to  support  the  insertable 
concept.  It  would  be  appropriate  to  readdress  this  alternative  after 
validating  the  insert  and  removal  times. 

The  objectives  of  this  particular  demonstration  were  achieved. 
A  technique  to  isolate  a  single  subsystem  was  developed  and  that  sub¬ 
system  and  its  alternative  were  addressed.  Additionally,  a  technique 
was  also  developed  to  reflect  scheduled  maintenance.  Finally,  the 
results  were  adequate  to  access  these  two  alternatives  and  to  identify 
areas  for  continued  consideration. 
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Operations  Manpower  Requirements 

Operation  manpower  requirements  were  updated  in  this  phase 
utilizing  the  prototype  proposal  delivery  schedules.  The  technique 
used  was  the  same  as  applied  in  the  conceptual  phase.  Therefore  no 
additional  discussion  will  be  provided.  The  data  are  presented  in 
Table  25. 


Copilot 

Nonpto* 

LooPmootor 


■ABC  REQUIREMENT  TRAINING  REQUIREMENT  DERIVATION 

I-CrMi/Alroro*  FYIMI  No*  Crow  RopiMromoiM  ♦  10%  Turnover 

IM-Unrt  Epwippod  AirwaN  Rook  F  VPO-04  10%  Tomovor 

lE-Trotront  Aircraft  NP  FVOEM  10%  Tomovor  hiaM  by  Ri—jpinum 


Tab*  25  OPERATIONS  MANPOWER  REQUIREMENTS  LIST 

PER  FV 

Scope  and  Magnitude  of  Training  and  Technical  Manuals  for 
Maintenance  Personnel 

Specialty  training  course  estimates  remain  the  same  as 
developed  for  the  conceptual  phase.  The  technique  described  in 
Section  II  was  used.  Technical  training  data  were  not  addressed  due 
to  delays  in  obtaining  comparability  data  from  the  0141  technical 
training  course.  Information  is  available  now,  however,  and 
technical  training  will  be  addressed  in  the  full-scale  development 
phase  of  this  demonstration. 
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Extensive  work  was  done  during  the  validation  phase  demon¬ 
stration  to  refine  the  job  guide  content  and  cost  algorithms.  A  signi¬ 
ficant  portion  of  this  work  was  accomplished  as  a  special  study  in 
support  of  the  F-16  SPO  technical  documentation  negotiations.  This 
newly  acquired  information  has  been  employed  during  this  phase  with 
the  following  results. 

Page  types  were  defined  in  the  conceptual  phase  as  narrative, 
schematic,  and  pictorial.  Table  26,  a  new  development,  now 
identifies  a  more  extensive  list  of  page  types  and  indicates  the  type 
manual  in  which  they  would  be  used  by  a  C  (conventional)  or  T  (task 
oriented).  Task-oriented  manuals  are  not  covered  for  shop  activities 
since  they  are  not  presently  used  in  that  area. 


P»f»  Type 

TS 

NTS 

F/L  Shop 

F/L  Shop 

Narrative 

C/T  C 

C  C 

Halt  Ton*  Art 

C  C 

c  c 

Half  Ton#  Explosion 

C 

c 

Electronic  Lina  Art 

C  C 

c 

Exploded  Line  Art 

C 

Fault  Isolation  Chan 

T 

Fault  Isolation  Schematic  Bloch 

T  C 

Access  Line  An 

T 

Fault  Isolation  Schematic  Flow 

T  C 

Fault  Isolation  Schematic  Mech/Hyd 

T  C 

Job  Guide  Narrative 

T 

Job  Guide  Illustrations 

T 

Table  26  PAGE  TYPES  FOR  CONVENTIONAL  (C)  ANO  TASKORIENTED  (T»  MANUALS 


The  determination  oi  the  number  and  type  pages  required  for 
each  type  manual  is  accomplished  by  algorithm.  The  input  data  re¬ 
quired  are  the  quantity  of  subsystems,  LRUs,  and  SRUs  within  a 
system,  and  the  quantity  of  actions  performed  at  the  subsystem, 
LRU,  and  SRI!  level.  The  algorithms  were  developed  after  an 
extensive  review  of  current  technical  data  manuals  and  were  derived 
through  regression  analysis  using  current  F-16  technical  manuals  as 
the  estimating  baseline.  The  complete  set  of  algorithms  is  given  in 
Volume  II  along  with  the  technical  manual  content  estimate  for  each 
equipment  configuration  addressed  in  this  phase. 
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The  algorithm  developed  to  predict  the  content  of  a  fault  isola¬ 
tion  manual  to  support  the  task-oriented  approach  to  flight  line  troube- 
shooting  is  provided  here  as  an  example.  The  algorithm  determines 
the  number  of  maintenance  actions,  pictorials,  and  schematics  as  a 
function  of  the  number  of  subsystems  and  l.RUs.  In  this  case: 

Number  of  actions  2  actions/subsystems  +  2  actions/LRU 
Number  of  pictorials  -  2  pictorials /LRU 

Number  of  schematics  -  1  schema! ic /subsystem  +  1  schematic/ 

LRU 

The  total  pages  are  then  calculated  as  follows; 

Number  of  pages  -  1  action  page/action  +  1/2  narrative  page/ 

LRU 

*  1  pictorial  page /pictorial 

*  2  Schematic  pages/subsystem 

*  1  schematic  page/I.RU 

In  this  type  manual  the  following  page  type  relationships  are  applicable-. 

action  page  fault  isolation  chart 
narrative  page  narrative 
pictorial  page  access  line  art 

subsystem  schematic  page  fault  isolation  schematic  block 
l.RU  schematic  page  =  fault  isolation  schematic  flow 

Additional  details  regarding  page  types  are  provided  in  Reference  11. 

All  algorithms  were  applied  during  this  phase  of  the  demonstra¬ 
tion.  The  results  for  the  2MI  I)  conventional  and  task-oriented  manuals 
are  presented  in  Tables  27  and  2H,  respectively.  The  difference  in 
content  between  the  two  gener  al  types  is  found  in  the  flight  line  manuals. 

Cost  estimates  tor  these  manuals  were  obtained  and  are  shown 
under  SOC  data.  Kstimates  .ire  based  on  individual  page  costs 
developed  from  a  detailed  analysis  of  each  page  type  considered.  Page 
costs  include  page  preparation,  verification  and  validation,  and 
contract  loading.  This  cost  information  is  also  included  in  Volume  II. 


Tafcto  27  2MFD  AVIONICS  CONVENTIONAL  MANUALS 


Tafefc  29  2MFD  AVIONICS  TASK  ORIENTEO  MANUALS 
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Training  for  Operations  Personnel 

In  the  validation  phase,  the  preliminary  operator  task  list 
prepared  in  the  conceptual  phase  is  expanded  in  detail.  For  demon¬ 
stration  purposes,  an  expanded  task  list  compatible  with  2 MFD 
avionics  was  prepared  for  pilot  and  copilot  duties.  This  expanded  task 
list  which  is  enclosed  in  Volume  n  as  part  of  the  "Personnel, 
Training,  and  Job  Guide  Section  of  the  AMST  Integrated  Logistics 
Support  Plan.  "  It  was  developed  from  validation  phase  data. 
Specifically,  AFFD1.-TM -76-45- FGR.  Advanced  Medium  STOL 
Transport  Crew  Systems  Technology  Program,  Austere  Cockpit 
Design,  Mission  Scenario  was  used.  Although  the  TM  was  prepared 
for  the  3MF1)  avionics  configuration,  the  results  were  adapted  to  a 
2MFD  avionics  configuration  by  dropping  those  tasks  which  were 
eliminated  by  integrated  controls  and  bv  redistributing  the  remainder 
between  the  pilot  and  copilot. 

The  expanded  task  list  was  reviewed  against  the  conceptual 
phase  estimate  of  operator  course  length.  Table  9,.  and  the  previous 
results  were  supported.  The  validation  phase  estimate  of  operator 
course  length,  however,  is  more  detailed  and  is  shown  in  Table  29. 


PHASE 

SEGMENT 

OUR  AT  ION* 

Initial 

Ctanroom 

14 

Simulator 

16 

Elymt 

IS 

tftnttan 

1 

T  ratal 

3 
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MHsion 
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14 

Flym* 

29 
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1 

'A  mu  mat  Silty 

ant  tcSaduN  and  mckidai  waakandt 

43  dayt 

Tdda  29  OPERATOR  COURSE  LENGTH 
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soc 


System  ownership  costs  were  derived  in  the  validation  phase 
by  selective  application  of  the  DAIS  LCC  model.  This  model  was  being 
developed  under  a  separate  effort  is  now  automated  and  driven 
directly  by  the  R&M  model.  Reference  material  is  identified  in  the 
Bibliography  (reference  5).  The  output  of  the  R#*M  model,  as  run  for 
each  AMST  avionics  and  landing  gear  option,  was  combined  with  a 
unique  AMST  SOC  data  base  which  is  also  provided  in  Volume  II.  The 
output  was  then  processed  through  the  system  ownership  cost  modules 
of  the  l.CC  model. 

With  this  improved  cost  model,  the  costs  could  now  be  sub¬ 
divided  into  support  investment  (non-recurring  costs)  and  operating 
and  support  (re  curring  costs).  SOC  was  obtained  for  all  desired  cost 
factors  except  costs  of  the  initial  maintenance  training  course, 
support  equipment,  and  support  equipment  maintenance.  The  cost 
data  are  presented  in  1976  dollars  and  are  shown  in  Table  30.  The 
areas  not  covered  will  be  thoroughly  investigated  during  the  full- 
scale  development  phase  demonstration.  Disposal  costs  were  not 
addressed  since  only  two  individual  systems  of  the  AMST,  avionics 
and  landing  gear,  were  under  consideration. 


Tabt*  30  AMST  SYSTEM  OWNERSHIP  COST  DATA 
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HR  and  SO C  Impact  and  High  Drivers 


The  HR  and  SOC  impact  was  described  in  Section  II  as  the 
summarization  and  presentation  of  HR  and  SOC  data  for  baselines  or 
alternatives  and  the  analysts  of  those  data  to  determine  feasibility, 
acceptability,  or  need  for  further  reiteration,  or  consideration.  Just 
as  more  accurate  and  efficient  methods  were  devised  to  develop  the 
HR  and  SOC  data,  a  better  method  to  summarize,  present,  and 
analyze  the  data  was  also  sought.  Two  formats  were  devised,  an 
abbreviated  impact  analysis  and  a  detailed  impact  analysis.  Samples 
of  each  format  were  developed  for  the  2MKD  vs  3MKD  avionics  option 
with  conventional  ISD/JGD  and  the  conventional  versus  task-oriented 
ISD/JGD  option  for  2MPD  avionics. 

The  abbreviated  format  addresses  all  HR  considerations  and 
SOC  (Tables  31  and  32).  It  quantifies  availability  (a  function  of 
reliability  and  maintainability),  maintenance  manpower,  training 
costs  per  year,  job  guide  documentation  investment  cost,  and  job 
guide  documentation  maintenance  costs  per  year.  The  abbreviated 
format  also  presents  SOC  in  terms  of  support  investment  cost  and 
operating  and  support  costs  per  year.  Risk  areas,  problems,  and 
recommendations  are  also  addressed.  Risk  areas  and  problems  may 
be  determined  from  a  review  of  the  HR  and  SOC'  data  for  "high 
drivers"  within  the  alternatives.  The  method  of  identifying  "high 
drivers"  and  sample  data  were  presented  in  Section  II,  The  method 
remains  the  same.  Risk  areas  associated  with  human  resources  may 
also  be  identified  by  judgment.  This  was  the  case  with  the  low  opera¬ 
tional  risk  identified.  This  risk  area  specifically  refers  to  the 
capability  of  a  pilot  and  a  copilot  to  perform  the  more  intense  and 
complex  tactical  missions  with  the  austere  avionics  suite  envisioned. 
The  recommendations  again  are  developed  from  the  human  resource 
and  system  ownership  cost  viewpoints  and  may  be  either  negated  or 
supported  by  operations,  design,  and  acquisition  considerations. 

The  detailed  impact  analysis  format  (Tables  33  and  34) 
expands  on  the  system  ownership  cost,  manpower,  and  technical 
areas.  It  also  adds  acquisition  cost  (system  investment),  operations, 
and  schedule  data.  This  format  appears  to  be  the  most  desirable  and 
with  the  addition  of  problems  and  recommendations  should  provide  a 
complete  yet  rather  simplified  display. 
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TAN  32  ABBREVIATED  IMPACT  ANALYSIS  -  2MFD  AVIONICS 
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Training  and  Job  Guide  Documentation  Products 

The  planned  product  for  the  validation  phase  was  a  personnel/ 
training/job  guide  plan.  The  goal  was  to  provide  an  input  to  a  valida¬ 
tion  phase  integrated  logistics  support  plan  (ILSP)  to  a  level  of  detail 
beyond  that  normally  expected  in  this  phase.  The  product,  "The 
personnel.  Training  and  Job  Guide  Section  of  the  Integrated  Logistic 
Support  Plan  for  the  Advanced  Medium  STOL  Transport"  is  presented 
in  Volume  n.  The  scope  and  detail  of  this  coordinated  section  was 
compared  with  similar  sections  of  the  F-16  full-scale  development 
ILSP.  The  AMST  product,  based  on  prototype  phase  personnel, 
training,  and  technical  manual  data  derived  through  the  CHRT  process, 
contained  more  useful  and  detailed  data. 

The  feasibility  of  determining  from  validation  phase  data  the 
emphasis  to  be  given  a  task  in  training  and/or  the  technical  manual 
was  also  explored  with  positive  results.  This  early  determination  is 
necessary  so  that  training  and  technical  manual  developers  may  better 
describe,  plan,  and  prioritize  the  full-scale  development  training  and 
technical  manual  efforts.  The  determination  has  been  automated  with 
a  prototype  task  intensity  matrix  program.  The  determination  is 
based  on  task  data  drawn  from  the  R&M  output  as  interpreted  by  the 
task  intensity  program.  The  complete  interpretation  technique  will  be 
described  in  a  subsequent  technical  report. 

The  task  intensity  program  identifies  a  requirement  for  train¬ 
ing  and/or  technical  manual  coverage  and  quantifies  the  requirement 
as  low  (1),  medium  (2),  or  high  (3).  Tasks  are  simply  categorized  as 
flight  line  non-troubleshoot,  flight  line  troubleshoot,  and  shop  repair. 
The  flight  line  tasks  are  addressed  at  the  subsystem  level,  while  shop 
repair  is  addressed  at  the  LRU  level.  The  determination  has  been 
performed  for  the  2MP1>  avionics  and  landing  gear  and  is  included  in 
"The  Personnel,  Training,  and  Technical  Manual  Section  of  the 
Integrated  Logistic  Support  Plan  for  the  Advanced  Medium  STOL 
Transport.  " 

The  presentation  format  is  called  a  task  intensity  matrix.  A 
portion  of  the  Task  Intensity  Matrix  for  the  2MFD  avionics  with  the 
task-oriented  option  is  shown  in  Table  35.  The  sample  shown  is  for 
FACUO  (HF  Radio-AN/ARC- 123)  and  DAC210  (VHF/FM  Radio-FM- 
622A).  The  indentured  codes  FAC111-FAC112  and  DAC213. 
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represent  LRUs  which  are  repaired  in  the  shop.  Estimates  of  the 
training/tech  manual  coverage  required  is  presented  as  a  fraction. 
For  example,  the  1/3  in  the  flight  line  troubleshoot  column 
opposite  DAC210  represents  a  low  requirement  for  training  coverage 
over  a  high  requirement  for  tech  manual  coverage. 
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Table  35  TASK  INTENSITY  MATRIX 

3.4  CONCLUSIONS  -  VALIDATION  (PROTOTYPE)  PHASE 

The  results  of  the  validation  (prototype)  phase  demonstration 
support  the  conceptual  phase  conclusion  that  HR  and  SOC  data  can  be 
developed  for  a  system  through  a  logical,  rational,  and  repeatable 
process.  The  specific  conclusions  follow. 

A.  Application  of  the  CHRT  process  and  CDB  is  feasible  in  the 

validation  phase. 

1.  The  more  detailed  data  required  for  the  continued  CDB 
evolution  required  to  support  a  more  detailed  design  can 
be  obtained  in  the  validation  phase. 

2.  The  CHRT  process  is  sensitive  at  the  subsystem  level  and 
can  be  used  to  address  components  of  the  subsystem. 

3.  The  personnel/training/technical  manual  concept, 
whether  conventional,  task-oriented,  or  a  mix,  can  be 
reflected  In  the  maintenance  action  networks  and  its 
influence  can  be  directly  reflected  in  the  HR  and  SOC 
estimates. 
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B.  The  validation  phase  products  have  been  identified  and  repre- 

sentative  samples  have  been  provided  and  evaluated  for  utility. 

1.  The  HR  and  SOC  derived  through  the  CHRT  process  during 
the  validation  phase  were  the  same  categories  as  concep¬ 
tual  phase  estimates  but  reflect  more  accurate  and 
detailed  input  data.  These  estimates  allow  the  system 
manager  to  influence  the  selection  of  the  full-scale 
development  baseline,  to  quantify  risk /payoff  areas,  and 
to  identify  viable  alternatives  for  continued  consideration 
during  full  scale  development. 

2.  The  estimates  derived  allow  the  early  development  of  a 
detailed  personnel/training /job  guide  plan. 

3.  A  newly  developed  validation  phase  product,  the  task 
intensity  matrix,  can  provide  an  early  indication  of 
unusual  requirements  in  training  and  job  guide  documenta¬ 
tion. 

C.  The  CDB,  as  modified,  supports  the  CHRT  process. 

1.  An  updated  and  expanded  SOC  model  has  been  added. 

2.  The  task  intensity  matrix  tool  has  been  added. 

D.  Inadequacies  and/or  inconsistencies  in  the  CHRT  process  and 

the  CDB  have  been  identified.  All  have  been  either  corrected 

or  earmarked  for  future  consideration. 

1.  The  RAM  model  must  be  improved  to  effectively  quantify 
support  equipment  needs  as  well  as  manpower.  This  must 
be  done  to  quantify  support  equipment  costs  and  to  provide 
complete  RAM  and  LOOM  compatibility. 

2.  Technical  training  must  be  addressed  to  totally  represent 
training  costs  per  year. 

3.  A  technique  to  determine  the  costs  to  establish  a  training 
course  should  be  considered. 

4.  A  technique  should  be  developed  to  address  the  phase  in 
and  phase  out  of  a  system.  Data  presently  reflect  a  fully 
phased-in  system. 

5.  Activity  was  not  initiated  on  LOOM  during  this  phase, 
although  LOOM  should  be  run  during  validation  on 
alternatives  of  specific  interest.  LOOM  runs  will  be 
made  during  the  full  development  phase  demonstration. 
Additionally,  RAM  and  LOOM  results  will  be  compared 
for  compatibility. 
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The  conclusions  made  during  tins  smm  i  part  ot  tin  (  HRT 
demonstration  will  he  reconsidered  m  tin-  third  md  final  part  of  the 
demonstration.  Final  conclusions  will  then  he  undressed  in  a  sub¬ 
sequent  technical  report. 

3.  5  VALIDITY  OF  THK  PRFDICTKl)  DATA 

A  central  issue  is  the  validity  of  the  conceptual  phase  require¬ 
ments  and  the  validation  phase  requirements  which  were  predicted  hy 
the  CURT  technique.  Indeed,  this  is  a  central  issue  to  all  predictive 
methodologies  used  throughout  system  acquisition  studies.  In  this 
demonstration  of  CURT,  there  is  no  external  evidence  regarding  the 
validity  of  the  predicted  requirements.  Confidence  in  the  predicted 
manpower,  reliability,  maintainability,  technical  data,  training,  and 
cost  requirements  is  dependent  upon  confidence  in  the  logic  of  the 
procedure,  the  reasonableness  of  the  assumptions,  and  the  relevance 
of  the  input  data. 

Clearly,  caution  must  be  used  in  applying  the  results  of  CHRT 
analyses  to  engineering  and  management  decision-making  during 
system  acquisition.  Clearly,  new  investigations  are  needed  to  address 
this  central  issue  of  the  validity  of  predicted  requirements.  However, 
CHRT,  even  in  its  present  form,  is  a  valuable  tool  for  the  weapon 
system  engineer  and  the  weapon  system  manager.  CHRT  provides  a 
systematic,  quantitative,  and  trackable  procedure  for  addressing  the 
human  resource,  logistic,  and  ownership  cost  issues  involved  in  a 
system  acquisition  program.  CHRT,  therefore,  represents  a  signifi¬ 
cant  advance  over  current  practices. 
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iv.  i  t:i  i.  scai  i:  m:\  ki.opmkn  r  dkmonsi  ration  plans 


The  demonstration  <>>  1'MRT  as  applied  in  a  full-scale  develop- 
m  nt  phase  will  be  conducted  between  16  August  1978  and  15  May 
1979.  The  AM  ST  n  min  an.  enginet -ruin  development  (MKD)  phase  was 
expected  to  he  the  den  .oust  rat  ion  vehicle  and  provide  both  a  real  time 
source  of  data  and  an  opportunity  tor  a  practical  application  of  CURT. 
Itie  AM  ST  program,  however,  ;s  delayed,  and  all  data  are  secured  as 
source  selection  sensitive*.  A MST  MKI)  phase  data,  therefore,  will  be 
simulated  with  projected  data  based  on  actual  hardware  from  the 
C-141  landing  Rear  and  existing  avionics.  HR  and  SOC'  data  will  be 
developed  for  the  2MI  I)  avionics  and  C-141  landing  gear.  Alternatives 
will  address  different  personnel,  training,  and  job  guide  documenta¬ 
tion  approaches;  and  different  detailed  designs  within  the  avionics  and 
landing  gear  systems. 

Significant  effort  will  also  be  expended  ui  the  development  of 
support  equipment  maintenance  action  networks  for  the  landing  gear. 
These  support  equipment  networks  will  be  integrated  with  the  landing 
gear  maintenance  action  networks  and  run  on  LOOM  to  quantify 
requirements  as  a  function  of  both  demand  on  support  equipment  and 
availability  of  support  equipment. 

Heavy  emphasis  will  also  be  placed  on  the*  development  of  the 
training  and  technical  manual  products  described  m  Al'HRL-TR-73-43 
and  as  perceived  by  the  CURT  process.  Intermediate  products  will 
include  an  annotated  task  identification  matrix  (ATIM),  ISD/JGI) 
decision  ground  rules,  a  level -of-detail  guide,  and  the  test  equipment 
and  tool  use  form.  The  final  products  will  be  a  full  range  of  training 
plans  and  job  guide  documentation  samples  supporting  both  the  con¬ 
ventional  and  task-oriented  approach.  These  products  will  all  be 
included  in  the  implementing  documentation  for  the  C’HRT  process. 
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